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Preface 



This volume discusses a construction situated at the intersection of two differ- 
ent mathematical fields: Abstract harmonic analysis, understood as the theory 
of group representations and their decomposition into irreducibles on the one 
hand, and wavelet (and related) transforms on the other. In a sense the volume 
reexamines one of the roots of wavelet analysis: The paper [60] by Grossmann, 
Morlet and Paul may be considered as one of the initial sources of wavelet 
theory, yet it deals with a unitary representation of the affine group, citing 
results on discrete series representations of nonunimodular groups due to Du- 
flo and Moore. It was also observed in [60] that the discrete series setting 
provided a unified approach to wavelet as well as other related transforms, 
such as the windowed Fourier transform. 

We consider generalizations of these transforms, based on a representation- 
theoretic construction. The construction of continuous and discrete wavelet 
transforms, and their many relatives which have been studied in the past 
twenty years, involves the following steps: Pick a suitable basic element (the 
wavelet ) in a Hilbert space, and construct a system of vectors from it by the 
action of certain prescribed operators on the basic element, with the aim of 
expanding arbitrary elements of the Hilbert space in this system. The associ- 
ated wavelet transform is the map which assigns each element of the Hilbert 
space its expansion coefficients, i.e. the family of scalar products with all el- 
ements of the system. A wavelet inversion formula allows the reconstruction 
of an element from its expansion coefficients. 

Continuous wavelet transforms, as studied in the current volume, are ob- 
tained through the action of a group via a unitary representation. Wavelet in- 
version is achieved by integration against the left Haar measure of the group. 
The key questions that are treated -and solved to a large extent- by means 
of abstract harmonic analysis are: Which representations can be used? Which 
vectors can serve as wavelets? 

The representation-theoretic formulation focusses on one aspect of wavelet 
theory, the inversion formula, with the aim of developing general criteria and 
providing a more complete understanding. Many other aspects that have made 
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wavelets such a popular tool, such as discretization with fast algorithms and 
the many ensuing connections and applications to signal and image processing, 
or, on the more theoretical side, the use of wavelets for the characterization 
of large classes of function spaces such as Besov spaces, are lost when we 
move on to the more general context which is considered here. One of the 
reasons for this is that these aspects often depend on a specific realization 
of a representation, whereas abstract harmonic analysis does not differentiate 
between unitarily equivalent representations. 

In view of these shortcomings there is a certain need to justify the use of 
techniques such as direct integrals, entailing a fair amount of technical detail, 
for the solution of problems which in concrete settings are often amenable to 
more direct approaches. Several reasons could be given: First of all, the in- 
version formula is a crucial aspect of wavelet and Gabor analysis. Analogous 
formulae have been - and are being - constructed for a wide variety of set- 
tings, some with, some without a group-theoretic background. The techniques 
developed in the current volume provide a systematic, unified and powerful 
approach which for type I groups yields a complete description of the possible 
choices of representations and vectors. As the discussion in Chapter 5 shows, 
many of the existing criteria for wavelets in higher dimensions, but also for 
Gabor systems, are covered by the approach. 

Secondly, Planclrerel theory provides an attractive theoretical context 
which allows the unified treatment of related problems. In this respect, my 
prime example is the discretization and sampling of continuous transforms. 
The analogy to real Fourier analysis suggests to look for nonabelian versions 
of Shannon’s sampling theorem, and the discussion of the Heisenberg group 
in Chapter 6 shows that this intuition can be made to work at least in special 
cases. The proofs for the results of Chapter 6 rely on a combination of direct 
integral theory and the theory of Weyl-Heisenberg frames. Thus the connec- 
tion between wavelet transforms and the Planclrerel formula can serve as a 
source of new problems, techniques and results in representation theory. 

The third reason is that the connection between the initial problem of char- 
acterizing wavelet transforms on one side and the Planclrerel formula on the 
other is beneficial also for the development and understanding of Planclrerel 
theory. Despite the close connection, the answers to the above key questions 
require more than the straightforward application of known results. It was 
necessary to prove new results in Planclrerel theory, most notably a precise 
description of the scope of the pointwise inversion formula. In the nonuni- 
modular case, the Planclrerel formula is obscured by the formal dimension 
operators, a family of unbounded operators needed to make the formula work. 
As we will see, these operators are intimately related to admissibility con- 
ditions characterizing the possible wavelets, and the fact that the operators 
are unbounded has rather surprising consequences for the existence of such 
vectors. Hence, the drawback of having to deal with unbounded operators, 
incurring the necessity to check domains, turns into an asset. 
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Finally the study of admissibility conditions and wavelet-type inversion 
formulae offers an excellent opportunity for getting acquainted with the 
Planclrerel formula for locally compact groups. My own experience may serve 
as an illustration to this remark. The main part of the current is concerned 
with the question how Planclrerel theory can be employed to derive admissibil- 
ity criteria. This way of putting it suggests a fixed hierarchy: First comes the 
general theory, and the concrete problem is solved by applying it. However, 
for me a full understanding of the Planclrerel formula on the one hand, and 
of its relations to admissibility criteria on the other, developed concurrently 
rather than consecutively. The exposition tries to reproduce this to some ex- 
tent. Thus the volume can be read as a problem-driven - and reasonably 
self-contained- introduction to the Planclrerel formula. 

As the volume connects two different fields, it is intended to be open to re- 
searchers from both of them. The emphasis is clearly on representation theory. 
The role of group theory in constructing the continuous wavelet transform or 
the windowed Fourier transform is a standard issue found in many introduc- 
tory texts on wavelets or time-frequency analysis, and the text is intended 
to be accessible to anyone with an interest in these aspects. Naturally more 
sophisticated techniques are required as the text progresses, but these are 
explained and motivated in the light of the initial problems, which are exis- 
tence and characterization of admissible vectors. Also, a number of well-known 
examples, such as the windowed Fourier transform or wavelet transforms con- 
structed from semidirect products, keep reappearing to provide illustration 
to the general results. Specifically the Heisenberg group will occur in various 
roles. 

A further group of potential readers are mathematical physicists with an 
interest in generalized coherent states and their construction via group repre- 
sentations. In a sense the current volume may be regarded as a complement to 
the book by Ali, Antoine and Gazeau [1]: Both texts consider generalizations 
to the discrete series case. [1] replaces the square-integrability requirement by 
a weaker condition, but mostly stays within the realm of irreducible represen- 
tations, whereas the current volume investigates the irreducibility condition. 
Note however that we do not comment on the relevance of the results pre- 
sented here to mathematical physics, simply for lack of competence. 

In any case it is only assumed that the reader knows the basics of locally 
compact groups and their representation theory. The exposition is largely self- 
contained, though for known results usually only references are given. The 
somewhat introductory Chapter 2 can be understood using only basic notions 
from group theory, with the addition of a few results from functional and 
Fourier analysis which are also explained in the text. The more sophisticated 
tools, such as direct integrals, the Planclrerel formula or the Mackey machine, 
are introduced in the text, though mostly by citation and somewhat concisely. 
In order to accomodate readers of varying backgrounds, I have marked some 
of the sections and subsections according to their relation to the core material 
of the text. The core material is the study of admissibility conditions, dis- 
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cretization and sampling of the transforms. Sections and subsections with the 
superscript * contain predominantly technical results and arguments which 
are indispensable for a rigorous proof, but not necessarily for an understand- 
ing and assessment of results belonging to the core material. Sections and 
subsections marked with a superscript ** contain results which may be con- 
sidered diversions, and usually require more facts from representation theory 
than we can present in the current volume. The marks are intended to provide 
some orientation and should not be taken too literally; it goes without saying 
that distinctions of this kind are subjective. 
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chronological order: Matthias Mayer, Twareque Ali and Anna Krasowska. The 
results in Section 2.7 were developed with Keith Taylor. 

Volkmar Liebsclrer, Markus Neuhauser and Olaf Wittich read parts of the 
manuscript and made many useful suggestions and corrections. Needless to 
say, I blame all remaining mistakes, typos etc. on them. 

In addition, I owe numerous ideas, references, hints etc. to Jean-Pierre 
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Henriclrs, Rupert Lasser, Michael Lindner, Wally Madyclr, Arlan Ramsay, 
Gunter Schlichting, Bruno Torresani, Guido Weiss, Edward Wilson, Gerhard 
Winkler and Piotr Wojdyllo. 

I would also like to acknowledge the support of the Institute of Biomathe- 
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and Statistics in Signal and Image Processing (HASSIP). 

Finally, I would like to thank Marina Reizakis at Springer, as well as the 
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Introduction 



1.1 The Point of Departure 



In one of the papers initiating the study of the continuous wavelet trans- 
form on the real line, Grossmann, Morlet and Paul [60] considered systems 
('0fc,a)b,aeRxR' arising from a single function ip £ L 2 (R) via 

ipb,a( x ) = \a\~ 1/2 tp ' 

They showed that every function ip fulfilling the admissibility condition 




1 , 



( 1 . 1 ) 



where K' = R. \ {0}, gives rise to an inversion formula 

f=[ [ (f,^b,a)^b,a-r^db , (1.2) 

JrJw m 

to be read in the weak sense. An equivalent formulation of this fact is that 

the wavelet transform 



/ !->■ V 4 ,f , V^f(b, a) = (/, Vv) 

is an isometry L 2 (R) -^L 2 (Kx M / , db-^%). As a matter of fact, the inversion 
formula was already known to Calderon [27], and its proof is a more or less 
elementary exercise in Fourier analysis. 

However, the admissibility condition as well as the choice of the measure 
used in the reconstruction appear to be somewhat obscure until read in group- 
theoretic terms. The relation to groups was pointed out in [60] -and in fact 
earlier in [16] -, where it was noted that ^b,a = 7r(6, a)ip, for a certain repre- 
sentation 7 r of the affine group G of the real line. Moreover, (1.1) and (1.2) 
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have natural group-theoretic interpretations as well. For instance, the measure 
used for reconstruction is just the left Haar measure on G. 

Hence, the wavelet transform is seen to be a special instance of the fol- 
lowing construction: Given a (strongly continuous, unitary) representation 
(7 T,Ti n ) of a locally compact group G and a vector 77 £ Tin, we define the 
coefficient operator 

V v : TLtt 9 ip e -> Vr,ip £ Cb(G) , v v (p(x) = (tp, tt(x)t]} . 

Here Gb(G) denotes the space of bounded continuous functions on G. 

We are however mainly interested in inversion formulae, hence we consider 
V rj as an operator Tin — » L 2 (G), with the obvious domain dom(V r T/ ) = {< 7 ? £ 
Tin : V v ip £ L 2 (G)}. We call 77 admissible whenever V v : Ti — > L 2 (G) is an 
isometric embedding, and in this case V rl is called (generalized) wavelet 
transform. While the definition itself is rather simple, the problem of identi- 
fying admissible vectors is highly nontrivial, and the question whether these 
vectors exist for a given representation does not have a simple general answer. 
It is the main purpose of this book to develop in a systematical fashion criteria 
to deal with both problems. 

As pointed out in [60], the construction principle for wavelet transforms 
had also been studied in mathematical physics, where admissible vectors 77 
are called fiducial vectors, systems of the type { 7 r(a :)?7 : x £ G} coherent 
state systems, and the corresponding inversion formulae resolutions of 
the identity; see [1, 73] for more details and references. 

Here the earliest and most prominent examples were the original coherent 
states obtained by time-frequency shifts of the Gaussian, which were studied 
in quantum optics [114]. Perelomov [97] discussed the existence of resolutions 
of the identity in more generality, restricting attention to irreducible repre- 
sentations of unimodular groups. In this setting discrete series representa- 
tions, i.e., irreducible subrepresentations of the regular representation Xq of 
G turned out to be the right choice. Here every nonzero vector is admissible 
up to normalization. Moreover, Perelomov devised a construction which gives 
rise to resolutions of the identity for a large class of irreducible representations 
which were not in the discrete series. The idea behind this construction was 
to replace the group as integration domain by a well-chosen quotient, i.e., to 
construct isometries Tin L 2 (G/H) for a suitable closed subgroup H. In all 
of these constructions, irreducibility was essential: Only the well-definedness 
and a suitable intertwining property needed to be proved, and Schur’s lemma 
would provide for the isometry property. 

While we already remarked that [60] was not the first source to comment on 
the role of the affine group in constructing inversion formulae, suitably general 
criteria for nonunimodular groups were missing up to this point. Grossmann, 
Morlet and Paul showed how to use the orthogonality relations, established for 
these groups by Duflo and Moore [38], for the characterization of admissible 
vectors. More precisely, Duflo and Moore proved the existence of a uniquely 
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defined unbounded selfadjoint operator C ^ associated to a discrete series rep- 
resentation such that a vector is admissible iff it is contained in the domain 
of CV, with 1 1 Ctt 77 1 1 = 1. A second look at the admissibility condition (1.1) 
shows that in the case of the wavelet transform on L 2 (]R) this operator is 
given on the Plancherel transform side by multiplication with |w|~ 1,/2 . This 
framework allowed to construct analogous transforms in a variety of settings, 
which was to become an active area of research in the subsequent years; a by 
no means complete list of references is [93, 22, 25, 48, 68, 49, 50, 51, 83, 7, 8]. 
See also [1] and the references therein. 

However, it soon became apparent that admissible vectors exist outside 
the discrete series setting. In 1992, Mallat and Zhong [92] constructed a 
transform related to the original continuous wavelet transform, called the 
dyadic wavelet transform. Starting from a function ip £ L 2 (R) satisfying 
the dyadic admissibility condition 

\ip(2 n u)\ 2 = 1 , for almost every wgl (1.3) 

nEZ 

one obtains the (weak-sense) inversion formula 

f = [ Y / (f,i’b,2n)iP b ,2«2- n db , (1.4) 

, ' R nez 

or equivalently, an isometric dyadic wavelet transform L 2 (R) -> L 2 (R x 
Z,d62 _ra dn), where dn denotes counting measure. Clearly the representation 
behind this transform is just the restriction of the above representation n to 
the closed subgroup H = {(&, 2") : b G R, n € Z} of G, and the measure under- 
lying the dyadic inversion formula is the left Haar measure of that subgroup. 
However, in one respect the new transform is fundamentally different: The 
restriction of 7r to 77 is no longer irreducible, in fact, it does not even contain 
irreducible subrepresentations (see Example 2.36 for details). Therefore (1.3) 
and (1.4), for all the apparent similarity to (1.1) and (1.2), cannot be treated 
in the same discrete series framework. 

The example by Mallat and Zhong, together with results due to Klauder, 
Isham and Streater [67, 74], was the starting point for the work presented in 
this book. In each of these papers, a more or less straightforward construction 
led to admissibility conditions - similar to (1.1) and (1.3) - for representa- 
tions which could not be dealt with by means of the usual discrete series 
arguments. The initial motivation was to understand these examples under a 
representation-theoretic perspective, with a view to providing a general strat- 
egy for the systematic construction of wavelet transforms. 

The book departs from a few basic realizations: Any wavelet transform 
V v is a unitary equivalence between 7 r and a subrepresentation of Xq, the left 
regular representation of G on L 2 (G). Hence, the Plancherel decomposi- 
tion of the latter into a direct integral of irreducible representations should 
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play a central role in the study of admissible vectors, as it allows to analyze 
invariant subspaces and intertwining operators. 

A first hint towards direct integrals had been given by the representations 
in [67, 74], which were constructed as direct integrals of irreducible repre- 
sentations. However, the particular choice of the underlying measure was not 
motivated, and it was unclear to what extent these constructions and the asso- 
ciated admissibility conditions could be generalized to other groups. Properly 
read, the paper by Carey [29] on reproducing kernel subspaces of L 2 (G) can be 
seen as a first source discussing the role of Plancherel measure in this context. 



1.2 Overview of the Book 

The contents of the remaining chapters may be roughly summarized as follows: 

2. Introduction to the group-theoretic approach to the construction of con- 
tinuous wavelet transforms. Embedding the discussion into L 2 (G). Formu- 
lation of a list of tasks to be solved for general groups. Solution of these 
problems for the toy example G = K. 

3. Introduction to the Plancherel transform for type I groups, and to the 
necessary representation-theoretic machinery. 

4. Plancherel inversion and admissibility conditions for type I groups. Exis- 
tence and characterization of admissible vectors for this setting. 

5. Examples of admissibility conditions in concrete settings, in particular for 
quasiregular representations . 

6. Sampling theory on the Heisenberg group. 

Chapter 2 is concerned with the collection of basic notions and results, 
concerning coefficient operators, inversion formulae and their relation to con- 
volution and the regular representations. In this chapter we formulate the 
problems which we intend to address (with varying degrees of generality) in 
the subsequent chapters. We consider existence and characterization of in- 
version formulae, the associated reproducing kernel subspaces of L 2 (G) and 
their properties, and the connection to discretization of the continuous trans- 
forms and sampling theorems on the group. Support properties of the arising 
coefficient functions are also an issue. Section 2.7 is crucial for the following 
parts: It discusses the solution of the previously formulated list of problems 
for the special case G = R. It turns out that the questions mostly translate 
to elementary problems in real Fourier analysis. 

Chapter 3 provides the ” Fourier transform side” for locally compact groups 
of type I. The Fourier transform of such groups is obtained by integrating func- 
tions against irreducible representations. The challenge for Plancherel theory 
is to construct from this a unitary operator from L 2 (G) onto a suitable di- 
rect integral space. This problem may be seen as analogous to the case of 
the reals, where the tasks consists in showing that the Fourier transform 
defined on L 1 (K) induces a unitary operator L 2 (R) — » L 2 (R). However, for 
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arbitrary locally compact groups the right hand side first needs to be con- 
structed, which involves a fair amount of technique. The exposition starts 
from a representation-theoretic discussion of the toy example, and during the 
exposition to follow we refer repeatedly to this initial example. 

Chapter 4 contains a complete solution of the existence and character- 
ization of admissible vectors, at least for type I groups and up to unitary 
equivalence. The technique is a suitable adaptation of the Fourier arguments 
used for the toy example. It relies on a pointwise Plancherel inversion for- 
mula, which in this generality has not been previously established. In the 
course of argument we derive new results concerning the Fourier algebra and 
Fourier inversion on type I locally compact groups, as well as an L 2 -version of 
the convolution theorem, which allows a precise description of L 2 -convolution 
operators, including domains, on the Plancherel transform side 4.18. We com- 
ment on an interpretation of the support properties obtained in Chapter 2 in 
connection with the so-called ’’qualitative uncertainty principle”. Using ex- 
istence and uniqueness properties of direct integral decompositions, we then 
describe a general procedure how to establish the existence and criteria for 
admissible vectors (Remark 4.30). We also show that these criteria in effect 
characterize the Plancherel measure, at least for unimodular groups. Section 
4.5 shows how the Plancherel transform view allows a unified treatment of 
wavelet and Wigner transforms associated to nilpotent Lie groups. 

Chapter 5 shows how to put the representation-theoretic machinery de- 
veloped in the previous chapters to work on a much-studied class of con- 
crete representations, thereby considerably generalizing the existing results 
and providing additional theoretic background. We discuss semidirect prod- 
ucts of the type xi H , with suitable matrix groups H . These constructions 
have received considerable attention in the past. However, the representation- 
theoretic results derived in the previous chapters allow to study generaliza- 
tions, e.g. groups of the sort N x U, where N is a homogeneous Lie group 
and H is a one-parameter group of dilations on N. The discussion of the Zak- 
transform in the context of Weyl-Heisenberg frames gives further evidence for 
the scope of the general representation-theoretic approach. 

The final chapter contains a discussion of sampling theorems on the Heisen- 
berg group H. We obtain a complete characterization of the closed leftinvari- 
ant subspaces of L 2 (H) possessing a sampling expansion with respect to a 
lattice. Crucial tools for the proof of these results are provided by the theory 
of Weyl-Heisenberg frames. 



1.3 Preliminaries 

In this section we recall the basic notions of representation theory, as far 
as they are needed in the following chapter. For results from representation 
theory, the books by Folland [45] and Dixmier [35] will serve as standard 
references. 
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The most important standing assumptions are that all locally compact 
groups in this book are assumed to be Hausdorff and second countable and all 
Hilbert spaces in this book are assumed to be separable. 

Hilbert Spaces and Operators 

Given a Hilbert space hi, the space of bounded operators on it is denoted by 
B(ht), and the operator norm by || • ||oo. U(ht) denotes the group of unitary 
operators on hi. Besides the norm topology, there exist several topologies of 
interest on B(hi). Here we mention the strong operator topology as the 
coarsest topology making all mappings of the form 

B(H) BT^Tpeht , 

with ?y £ hi arbitrary, continuous, and the weak operator topology, which 
is the coarsest topology for which all coefficient mappings 

B(hi) 9 T i— > (ip, Trj) eC, 

with ip,i 7 £ hi arbitrary, are continuous. Furthermore, let the ultraweak 
topology denote the coarsest topology for which all mappings 

B(hi)3T^J2^Tr In) 
ne N 

are continuous. Here ( 77 „) ne ^ and (y>n) n eN range over all families fulfilling 

imi 2 < 00 > ii^ii 2 < 00 • 

neN neN 

We use the abbreviations ONB and ONS for orthonormal bases and 
orthonormal systems, respectively. dim(7-f) denotes the Hilbert space dimen- 
sion, i.e., the cardinality of an arbitrary ONB of hi. Another abbreviation is 
the word projection, which in this book always refers to selfadjoint projec- 
tion operators on a Hilbert space. For separable Hilbert spaces, the Hilbert 
space dimension is in N U { 00 }, where the latter denotes the countably infi- 
nite cardinal. The standard index set of cardinality m (wherever needed) is 
I m = {1, . . . , to}, where 1^ = N, and the standard Hilbert space of dimension 
m is 

If (Wj)ie/ is a family of Hilbert spaces, then © i6/ Hi is the space of vectors 
{'■Pi)iei in the cartesian product fulfilling in addition 

IIO^WII 2 “Xlll^H 2 < 00 • 

ie/ 

The norm thus defined on © ig/ 7Y,; is a Hilbert space norm, and © i6/ 7Y,; is 
complete with respect to the norm. If the Hi are orthogonal subspaces of a 
common Hilbert space H, © i6 /?ii is canonically identified with the closed 
subspace generated by the union of the Hi- 

If T is a densely defined operator on H which has a bounded extension, 
we denote the extension by [T], 
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Unitary Representations 



A unitary, strongly continuous representation, or simply representa- 
tion, of a locally compact group G is a group homomorphism 7r : G — > U(H n ) 
that is continuous, when the right hand side is endowed with the strong op- 
erator topology. Since weak and strong operator topology coincide on U(Ti. n ), 
the continuity requirement is equivalent to the condition that all coefficient 
functions of the type 

G B x i— > (<£, n(x)r]} £ C, 



are continuous. 

Given representations cr, n, and operator T : Ha — > H v is called inter- 
twining operator, if Ta(x) = ir(x)T holds, for all x € G. We write cr ~ 7r 
if cr and 7r are unitar ily equivalent, which means that there is a unitary in- 
tertwining operator U : H a — * H % . It is elementary to check that this defines 
an equivalence relation between representations. For any subset 1C C H v we 
let 



7t(G)/C = {tt(x)t] : x £ G, p £ K,} . 



A subspace of K. C H n is called invariant if 7 t(G)JC C tC. Orthogonal comple- 
ments of invariant subspaces are invariant also. Restriction of a representation 
to invariant subspaces gives rise to subrepresentations. We write cr < 7r if 
cr is unitarily equivalent to a subrepresentation of n. a and 7r are called dis- 
joint if there is no nonzero intertwining operator in either direction. A vector 
r] £ Htt is called cyclic if 7r(G)?7 spans a dense subspace of H n . A cyclic rep- 
resentation is a representation having a cyclic vector. All representations 
of interest to us are cyclic. In particular our standing assumption that G is 
second countable implies that all representations occurring in the book are 
realized on separable Hilbert spaces, tt is called irreducible if every nonzero 
vector is cyclic, or equivalently, if the only closed invariant subspaces of H n 
are {0} and H^. Given a family ( 7 rj)j 6 j, the direct sum 7 r = © ieJ 7r,; acts on 
© i6/ via 

n(x) (<Pi) ieI = (MxMliei ■ 



The main result in connection with irreducible representations is Schur’s 
lemma characterizing irreducibility in terms of intertwining operators. See [45, 
3.5] for a proof. 

Lemma 1.1. If 7Ti,7T2 are irreducible representations, then the space of in- 
tertwining operators between 7Ti and n 2 has dimension 1 or 0, depending on 
7Ti ~ 7T2 or not. 

In other words, 7Ti and n 2 are either equivalent or disjoint. 

Using the spectral theorem the following generalization can be shown. The 
proof can be found in [66, 1.2.15]. 
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Lemma 1.2. Let 7Ti,7T2 be representations of G, and let T : 7 i ni — > Tt n2 be 
a closed intertwining operator, defined on a dense subspace V C Tl ni . Then 
ImT and (kerT) -1 are invariant subspaces and 7Ti, restricted to (kerT) -1 , is 
unitarily equivalent to the restriction of 1:2 to ImT) . 

If moreover, ni is irreducible, T is a multiple of an isometry. 

Given G, the unitary dual G denotes the equivalence classes of irreducible 
representations of G. Whenever this is convenient, we assume the existence 
of a fixed choice of representatives of G, taking recourse to Schur’s lemma to 
identify arbitrary irreducible representations with one of the representatives 
by means of the essentially unique intertwining operator. 

We next describe the contragredient n of a representation 7 r. For this pur- 
pose we define two involutions on B{ Tin), which are closely related to taking 
adjoints. For this purpose let T € B(H n ). If (ej), e / is any orthonormal basis, 
we may define two linear operators T* and T by prescribing 

(T*ej ,ej) = (Tej,ei) , (Tei,ej) = (Tei,ej) . 

It is straightforward to check that these definitions do not depend on the 
choice of basis, and that T* = T , as we expect from finitedimensional matrix 
calculus. Additionally, the relations T ( = T* = T* and (ST)* = T^S*, ST = 
S T are easily verified. 

Now, given a representation ( 7 the (standard realization of the) 
contragredient representation It acts on by 7 f(x) = n(x). In general, 

7T qf. 7T. 

Commuting Algebras 

The study of the commuting algebra, i.e., the bounded operators intertwining 
a representation with itself, is a central tool of representation theory. In this 
book, the commutant of a subset M C B(H), is denoted by M' , and it is 
given by 

M' = {Te B(H) :TS = ST , VS 1 e M} . 

It is a von Neumann algebra, i.e. a subalgebra of B( TC) which is closed un- 
der taking adjoints, contains the identity operator, and is closed with respect 
to the strong operator topology. The von Neumann density theorem [36, The- 
orem 1.3.2, Corollary 1.3.1] states for selfadjoint subalgebras A C B(H), that 
closedness in any of the above topologies on B(H) is equivalent to A = A”. 

There are two von Neumann algebras associated to any representation 7r, 
the commuting algebra of 7 r, which is the algebra 7 t(G) / of bounded oper- 
ators intertwining n with itself, and the bicommutant n(G)" , which is the 
von Neumann algebra generated by 7 t(G). Since span(7r(G)) is a selfadjoint 
algebra, the von Neumann density theorem entails that it is dense in 7r(G)" 
with respect to any of the above topologies. Invariant subspaces are conve- 
niently discussed in terms of 7r(G)', since a closed subspace K, is invariant 
under 7r iff the projection onto K, is contained in 7 r(G)'. 
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Von Neumann algebras are closely related to the spectral theorem for 
selfadjoint operators, in the following way: Let A be a von Neumann algebra, 
and let T be a bounded selfadjoint operator. If S is an arbitrary bounded 
operator, it is well-known that S commutes with T iff S commutes with all 
spectral projections of T. Applying this to 5 G A' , the fact that A = A" 
yields the following observation. 

Theorem 1.3. Let A is a von Neumann algebra on Ti and T = T* G £>(74). 
Then T G A iff all spectral projections of T are in A. 

A useful consequence is that von Neumann algebras are closed under the 
functional calculus of selfadjoint operators, as described in [101, VII. 7]. 

Corollary 1.4. Let A is a von Neumann algebra on 7 i and T = T* e A 
selfadjoint. Let f : R. — > R. be a measurable function which is bounded on the 
spectrum of T . Then f(T) G A. 

Proof. Every spectral projection of f(T) is a spectral projection of T. Hence 
the previous theorem yields the statement. 

For more details concerning the spectral theorem we refer the reader to 
[101, Chapter VII]. The relevance of the spectral theorem for the representa- 
tion theory of the reals is sketched in Section 2.7. 



Tensor Products 

The tensor product notation is particularly suited to treating direct sums of 
equivalent representations. Let 74, /C be Hilbert spaces. The Hilbert space 
tensor product Tt 0 1C is defined as the space of bounded linear operators 
T : 1C — » 74 satisfying 



miW : =E n^'ii 2 < oo . 

jeJ 

Here is an ONB of 1C. The Parseval equality can be employed to show 

that the norm is independent of the choice of basis, making Tt 0 K, a Hilbert 
space with scalar product 



(S,T) = Y,(Se j ,Te j ) . 

Of particular interest are the operators of rank one. We define the elementary 
tensor ip ® p as the rank one operator 1C — > Tt defined by 1C 9 z i— > (z,rj}ip. 
The scalar product of two rank one operators can be computed as 



(r? 0 <£, r?' <S> <p%®/c = (v, v')h( v',T>)k ■ 
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Note that our definition differs from the one in [45] in that our tensor product 
consists of linear operators as opposed to conjugate-linear in [45]. As a con- 
sequence, our elementary tensors are only conjugate-linear in the /C variable, 
as witnessed by the change of order in the scalar product. However, the argu- 
ments in [45] are easily adapted to our notation. For computations in Ti (g) /C, 
it is useful to observe that ONB’s (r/,)i e / C H and C K, yield an ONB 

(r) i (g) ofHg/C [45, 7.14] . By collecting terms in the expansion with 

respect to the ONB, one obtains that each T £ H 0 1C can be written as 

t = a j ® tpj = y; ??,; <g> 6, ; , ( 1 . 5 ) 

jeJ iel 

where the a ? and are computed by aj = Tipj and = T*rji, yielding 

T=^(Tip j )®ip j = '^2r} i ®(T*rii) , (1.6) 

j£J i£l 



as well as 

rt = £iM a = 5>ii a ■ 

j£J i£l 

By polarization of this equation we find that given a second operator S = 
c j ® <Pj, the scalar product can also be computed via 

(T,5) = ^(a j)Cj ) . 

jeJ 

Operators T € B(TL ), S £ B(1C) act on elements on H®K, by multiplication. 
On elementary tensors, this action reads as 

(T <g> S') (77 (g <p) = T o (77 (g ip) o S = (Trj) ® (S*<p) , 

which will be denoted by T (g) S £ B{TL 0 1C). Keep in mind that this tensor 
is also only sesquilinear. Given two representations 7r, a, the tensor product 
representation 7T(g>cr is the representation of the direct product GxG acting 
on via 7r® a(x, y) = n (x)®a(y)* . On elementary tensors this action 

is given by 

( 7 r ® W(x, y))(r/ <g> ip) = (7r(x)y) (g) (a(x)ip) . 

Observe that the sesquilinearity of our tensor product notation entails that 
the restriction of n (g) a to {1} (g> G is indeed equivalent to dim(7i T ) • a, where 
a is the contragredient of a. 

One can use the tensor product notation to define a compact realization 
of the multiple of a fixed representation. Given such a representation a, the 
standard realization of 7r = m • a acts on = TL a (g) £ 2 (/ m ) by 



7r(a;) = cr(x) <B> ■ 
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The advantage of this realization lies in compact formulae for the associated 
von Neumann algebras, if a is irreducible: 

7T(GY = 1 ® B(e 2 (I m )) , (1.7) 

which is understood as the algebra of all operators of the form Id-^ (g> T, and 

tt(G)" = B{H a ) ® 1 , (1.8) 

with analogous definitions. The follow for instance by [105, Theorem 2.8.1]. 



Trace Class and Hilbert-Schmidt Operators 

Given a bounded positive operator T on a separable Hilbert space H, T it is 
called trace class operator if its trace class norm 

||T||i = trace(T) = ^(Tjji,^) < oo , 

is/ 

where (??,;) ie j is an ONB of H. ||T||i can be shown to be independent of the 
choice of ONB. An arbitrary bounded operator T is a trace class operator 
iff |T| is of trace class. This defines the Banach space B\{7i) of trace clase 
operators. The trace 

trace(T) = E< T ^> 

n£N 

is a linear functional on B\{H), and again independent of the choice of ONB. A 
useful property of the trace is that trace(TS') = trace(ST), for all T € B\(H) 
and S € Boo{H). 

More generally, we may define for arbitrary 1 < p < oo the Schatten-von 
Neumann space of order p as the space B p ( H) of operators T such that 
|T| P is trace class, endowed with the norm 

\\T\\ p =\\(T*Ty/X /P • 

Again B P (H) is a Banach space with respect to || • || p . An operator T is in 
B p {7i) iff |T| has a discrete p-summable spectrum (counting multiplicities). 
This also entails that B p (Ti) C B r (H), for p < r, and that these spaces are 
contained in the space of compact operators on H. Moreover, it entails that 
II • lloo < II • llp- 

As a further interesting property, B P (H) is a twosided ideal in B(H), sat- 
isfying 

||ATB|| P < HAiuiryiBHoo . 

We will exclusively be concerned with p = 1 and p = 2. Elements of the latter 
space are called Hilbert-Schmidt operators) . B- 2 {H) is a Hilbert space, 
with scalar product 
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{S, T) = trace (ST*) = trace(T'*S) . 

In fact, as the formula 

tra,ee(T*T) = Y / \\ T Vi \\ 2 = \\T\\ 2 h®h 

iei 

shows, Bzi'H) = Tt <S> H. In particular, all facts involving the role of rank-one 
operators and elementary tensors presented in the previous section hold for 



Measure Spaces 

In this book integration, either on a locally compact group or its dual, is 
ubiquitous. Borel spaces provide the natural context for our purposes, and we 
give a sketch of the basic notions and results. For a more detailed exposition, 
confer the chapters dedicated to the subject in [15, 17, 94], 

Let us quickly recall some definitions connected to measure spaces. A 
Borel space is a set X equipped with a cr-algebra B , i.e. a set of subsets 
of X (containing the set X itself) which is closed under taking complements 
and countable unions. B is also called Borel structure. Elements of B are 
called measurable or Borel. A cr-algebra separates points, if it contains 
the singletons. Arbitrary subsets A of a Borel space measurable or 

not, inherit a Borel structure by declaring the intersections A D B, B £ B, as 
the measurable sets in A. 

In most cases we will not explicitly mention the cr-algebra, since it is 
usually provided by the context. For a locally compact group, it is generated 
by the open sets. For countable sets, the power set will be the usual Borel 
structure. A measure space is a Borel space with a (cr-additive) measure /.t 
on the cr-algebra. ^-nullsets are sets A with i'(A) = 0, whereas conull sets 
are complements of nullsets. 

If n and v are measures on the same space, /r is rc-absolutely continuous 
if every /i-nullset is a /i-nullset as well. We assume all measures to be cr-finite. 
In particular, the Radon-Nikodym Theorem holds [104, 6.10]. Hence absolute 
continuity of measures is expressable in terms of densities. 

Measurable mappings between Borel spaces are defined by the property 
that the preimages of measurable sets are measurable. A bijective mapping 
(f> : X — > Y between Borel spaces is a Borel isomorphism iff <f> and 0 _1 is 
measurable. A mapping X — > Y is /r-measurable iff it is measurable outside 
a /i-nullset. For complex-valued functions / given on any measure space, we let 
supp(/) = f~\C \ 0). Inclusion properties between supports are understood 
to hold only up to sets of measure zero, which is reasonable if one deals with 
L p -functions. Given a Borel set A , we let 1 a denote its indicator function. 

Given a measurable mapping : X — > Y between Borel spaces and a 
measure /i on X, the image measure on Y is defined as $*(n)(A) = 
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/i(^ _1 (A)). A measure v on Y is a pseudo-image of /i under $ if v is equiva- 
lent to <?*(/!), and fl is a finite measure on X which is equivalent to g. fl exists 
if g is cr-fmite. Clearly two pseudo-images of the same measure are equivalent. 

Let us now turn to locally compact groups G and G-spaces. A G-space 
is a set X with a an action of G on X, i.e., a mapping G x X — > X, 
( g,x ) e- > g.x , fulfilling e.x = x and g.(h.x) = ( gh).x . A Borel G-space is a 
G-space with the additional property that G and X carry Borel structures 
which make the action measurable; here G x X is endowed with the product 
Borel structure. If A is a G-space, the orbits G.x = {g.x : g £ G} yield a 
partition of X, and the set of orbits or orbit space is denoted X/G for the 
orbit space. This notation is also applied to invariant subsets: If A C X is 
G-invariant, i.e. G.A = A , then A/G is the space of orbits in A , canonically 
embedded in X/G. If X is a Borel space, the quotient Borel structure 
on X is defined by declaring all subsets A C X/G as Borel for which the 
corresponding invariant subset of X is Borel. It is the coarsest Borel structure 
for which the quotient map X — > X/G is measurable. 

For x £ X the stabilizer of x is given by G x — {g £ G : g.x = x}. The 
canonical map G B g i— > g.x induces a bijection G/G x — > G.x. 




2 



Wavelet Transforms 

and Group Representations 



In this chapter we present the representation-theoretic approach to continuous 
wavelet transforms. Only basic representation theory and functional analysis 
(including the spectral theorem) are required. The main purpose is to clarify 
the role of the regular representation, and to develop some related notions, 
such as selfadjoint convolution idempotents, which are then used for the for- 
mulation of the problems which the book addresses in the sequel. Most of 
the results in this chapter may be considered well-known, or are more or less 
straightforward extensions of known results, with the exception of the last 
two sections: The notion of sampling space and the related results presented 
in Section 2.6 are apparently new. Section 2.7 contains the discussion of an 
example which is crucial for the following: It motivates the use of Fourier 
analysis and thus serves as a blueprint for the arguments in the following 
chapters. 



2.1 Haar Measure and the Regular Representation 

Given a second countable locally compact group G, we denote by hg a left 
Haar measure on G, i.e. a Radon measure on the Borel u-algebra of G which 
is invariant under left translations: fic{xE) = iiq{E). Since G is cr-compact, 
any Radon measure v on G is inner and outer regular, i.e., for all Borel sets 
A C G and e > 0 there exist sets C C A C V with C compact, V open such 
that v(V \C) < e. 

One of the pillars of representation theory of locally compact groups is 
the fact that Haar measure always exists and is unique up to normalization. 
We use a simple dx to denote integration against pc, and \A\ = ^g(A) for 
Borel subsets A C G. An associated rightinvariant measure, the so called 
right Haar measure is obtained by letting ^c,r{A) = |A _1 |. The modular 
function Aq : G — > R + measures the rightinvariance of the left Haar measure. 
It is given by Aq{x) = for an arbitrary Borel set E of finite positive 
measure. Using the fact that is unique up to normalization, one can show 
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that Aq is a well-defined continuous homomorphism, and independent of the 
choice of E. The homomorphism property entails that Aq is either trivial or 
unbounded: Aq{G) is a subgroup of the multiplicative R + , and all nontrivial 
subgroup of the latter are unbounded. Aq can also be viewed as a Radon- 
Nikodym derivative, namely 

, _ duo 

^ G i ? 

dfJyG,r 

see [45, Proposition 2.31]. Hence the following formula, which will be used 
repeatedly [45, (2.32)]: 



I f{x)dx = [ f(x 1 )A g {x l )dx 
JG JG 



(2.1) 



G is called unimodular if Aq = 1, which is the case iff pc is rightinvariant 
also. 

We will frequently use invariant and quasi-invariant measures on quotient 
spaces. If H < G is a closed subgroup, we let G/H = {xH : x € G}, which is a 
Hausdorff locally compact topological space. G acts on this space by y.(xH) = 
yxH , and the question of invariance of measures on G/H arises naturally. 
Given any measure v on G/H let v g be the measure given by v g (A) = v{gA). 
Then v is called invariant if v g = v for all g € G, and quasi-invariant if v,, 
and v are equivalent. The following lemma collects the basic results concerning 
quasi-invariant measures on quotients. 



Lemma 2.1. Let G be a locally compact group, and H < G. 



(a) 

(b) 

(c) 



There exists a quasi-invariant Radon measure on G/H . All quasi-invariant 
Radon measures on G/H are equivalent. 

There exists an invariant Radon measure on G/H iff Ah is the restriction 
of Ag to H . 

If there exists an invariant Radon measure Hg/h on G/H, it is unique 
up to normalization. After picking Haar measures on G and H , the nor- 
malization of t'G/H can l> e chosen such as to ensure Weil’s integral 
formula 



f{x)dx = 



/ G/H J H 



f {xh)dhdg G /H {xH) 



(2.2) 



The invariance property of Haar measure implies that the left translation 
action of the group on itself gives rise to a unitary representation on L 2 (G). 
The result is the regular representation defined next. 



Definition 2.2. Let G be a locally compact group. The left (resp. right) 
regular representation Xq (qg) acts on L 2 (G) by 



(A c(x)f)(y ) = f(x 1 y) resp. ( g G (x)f)(y ) = A G (x) 1/2 f(yx) 



The two-sided representation of the product group G x G is defined as 
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(A G x Q G )(x,y) = A g(x)qg{v) ■ 

Xc-invariant subspaces are called leftinvariant . 

The convolution of two functions /, g on G is defined as the integral 

{f*g)(x)= [ f{y)g{y~ l x)dy . (2.3) 

Jg 

This is well-defined, with absolute convergence for almost every x € G, 
whenever f,g £ L 1 (G). But L 2 -functions can be convolved also, if we employ 
a certain involution. 

Definition 2.3. Given any function f on G, define f*(x) = f(x~ 1 ). 

Remark 2.f. If / is p-integrable with respect to left Haar measure, then /* is 
p-integrable with respect to right Haar measure, and vice versa. In general, 
/* will not be in L P (G) if / is. Notable exceptions are given by the (trivial) 
case that G is unimodular, or more generally, that / is supported in a set on 
which Aq 1 is bounded. 

The mapping / i— > /* is obviously a conjugate-linear involution. With 
respect to convolution, the involution turns out to be an antihomomorphism: 

{g *f)*(x)= [ g{y)f{y~ 1 x~ 1 )dy 
Jg 

= [ g*(y~ 1 )f*{xy)dy 
Jg 

= f f*(y)g*((x- 1 y)- 1 )dy 

Jg 

= [ f*{x)g*(y~ 1 x)dy 
Jg 

= f**g*(x) . 

Note that our definition differs from the notation in [45, 35]. Our choice is 
motivated by proposition 2.19 below which clarifies the connection between 
the involution and taking adjoints of coefficient operators. 

The following simple observation relates convolution to coefficient functions: 

Proposition 2.5. For f,geL 2 (G), 

(g*f*)(x)= f g(y)f(x~ 1 y)dy = (g } \ G (x)f) , (2.4) 

Jg 

in particular the convolution integral g * f* converges absolutely for every x, 
yielding a continuous function which vanishes at infinity. 
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Proof. Equation (2.4) is self-explanatory, and it yields pointwise absolute con- 
vergence of the convolution product. Continuity follows from the continuity of 
the regular representation. Recall that a function / on G vanishes at infinity 
if for every e > 0 there exists a compact set C C G such that |/| < e outside of 
C. If / and g are compactly supported, it is clear that g* f* also has compact 
support, hence vanishes at infinity. For arbitrary L-functions / and g pick 
sequences /„ — > / and g n — > g with f n , g n G C c (G). Then the Cauchy-Sclrwarz 
inequality implies g m * fn — * ► g * f* uniformly, as to, n — > oo. But then the 
limit vanishes at infinity also. 

The von Neumann algebras generated by the regular representation are 
the left and right group von Neumann algebras. 

Definition 2.6. Let G be a locally compact group. The von Neumann algebras 
generated by the left, and right regular representations are 

VNt(G) = A g (G)" and VN r {G) = q g {G)" . 

VNi(G) and VN r (G) obviously commute; in fact VNi(G)' = VN r {G). If the 
group is abelian, VNi{G ) = VN r (G) =: VN{G). 

The equality VNi(G)' = VN r (G) is a surprisingly deep result, known as the 
commutation theorem. For a proof, see [109]. 



2.2 Coherent States and Resolutions of the Identity 

In this section we present a general notion of coherent state systems. Basically, 
the setup discussed in this section yields a formalization for the expansion 
of Hilbert space elements with respect to certain systems of vectors. The 
blueprint for this type of expansions is provided by ONB’s: If g = is 

an ONB of a Hilbert space hi, it is well-known that the coefficient operator 

V v :l «p, ru)) ieI G £\I) (2.5) 

is unitary, and that every ip G TL may be written as 

T = ^2(TPli)Vi ■ ( 2 - 6 ) 

iei 

The generalization discussed here consists in replacing / by a measure space 
and summation by integration. In the following sections we will 
mostly specialize to the case X = G, a locally compact group, endowed with 
left Haar measure. However, in connection with sampling we will also need 
to discuss tight frames (obtained by taking a discrete space with counting 
measure), which is why have chosen to base the discussion on a slightly more 
abstract level. 
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Definition 2.7. Let TL be a Hilbert space. Let p = (p x ) x ^x denote a family 
of vectors, indexed by the elements of a measure space (X,B,p). 

(a) If for all ip GH. the coefficient function 

V v <p : X 9 x e-> {(p,r] x ) 

is pi-measurable, we call r) a coherent state system. 

(b) Let (j] x ) x( zx be a coherent state system, and define 

dom(V^) := {p € TL : V v <p G L 2 (X,p)} , 

which may be trivial. Denote by V v : Ti — ► L 2 (X,p) the (possibly un- 
bounded) coefficient operator or analysis operator with domain D.„. 

(c) The coherent state system ( tj x ) x ex is called admissible if the associated 
coefficient operator V n : i— > V v p is an isometry, with dom(V^) = Ti- 
lt would be more precise to speak of ^-admissibility, since obviously the 

property depends on the measure. However, we treat the measure space 
(X, B. n) as given; it will either be a locally compact group with left Haar 
measure, or a discrete set with counting measure. 

We next collect a few basic functional-analytic properties of coherent state 
systems. The following observation will frequently allow density arguments in 
connection with coefficient operators: 

Proposition 2.8. For any coherent state system {rj x ) X £x> the associated co- 
efficient operator is a closed operator. 

Proof. Let ip n — » <p, where ip n G dom(V^). Assume in addition that V v ip n — > 
F in L 2 {X,fj). After passing to a suitable subsequence we may assume in 
addition pointwise almost everywhere convergence. Now the Cauchy-Schwarz- 
inequality entails 

I V v (p n {x) - (tp,Vx}\ = | {<Pn - T,Vx)\ < \\Tn - P\\ \\Vx\\ 0 , 

hence F = V v ip a.e., in particular the right hand side is in L 2 (A, p). 

Next we want to describe adjoint operators. For this purpose weak integrals 
will be needed. 

Definition 2.9. Let (ij x ) x ^x be a coherent state system. If the right-hand side 

of 

T >-> / (<p,r}x)dfJ,(x) 

Jx 

converges absolutely for all ip, and defines a continuous linear functional on Ti, 
we let the element of TL corresponding to the functional by the Fischer-Riesz 
theorem be denoted by the weak integral 
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Vxdp,( x) 



Hence we obtain the following defining relation for j x ri x dp(x): 



V, J V xdfi(x)j = j (ip, r] x )dn(x ) 



For a family of operators (T x ) xe x we define the weak operator integral f x T x dx 
pointwise as 



J T^x'j (ip) = J T x (ip) dx , 



whenever the right-hand sides converges weakly for every ip. 

Proposition 2.10. Let (r]x)xex be a coherent state system. The associated 
coefficient operator V v is bounded on TL iff dom(V^) = 7 I. In that case, its 
adjoint operator is the synthesis operator, given pointwise by the weak in- 
tegral 

V*(F) = [ F(x)r lx dn(x) . (2.8) 

Jx 

Proof. The first statement follows from the closed graph theorem and the 
previous proposition. For (2.8) we compute 



(V v tp, F) = / (tp,ii x )F(x)dp(x) = / (ip,F(x)r] x )dn(x) 

Jx Jx 

ip, / F(x)r) x dp(X) 

Jx 

We will next apply the proposition to admissible coherent state systems. 
Note that for such systems 77 the isometry property entails that V*V v is the 
identity operator on TL, and V v V* is the projection onto the range of V n . The 
first formula, the inversion formula, can then be read as a (usually continuous 
and redundant) expansion of a given vector in terms of the coherent state sys- 
tem. An alternative way of describing this property, commonly used in math- 
ematical physics, expresses the identity operator as the (usually continuous) 
superposition of rank-one operators. In order to present this formulation, we 
use the bracket notation for rank-one operators: 

\r)}(ip\:ip^ (ip\ip}r] . (2.9) 

Note the attempt to reconcile mathematics and physics notation by letting 
(rj\ip) = (iPiV)- I n particular, the bracket (2.9) is linear in 77 and antilinear in 
if. Outside the following proposition, we will however favor the tensor product 
notation 77 ® if over the bracket notation. 
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Proposition 2.11. If {j] x ) x ^x is an admissible coherent state system, then 
for every ip £ Tt, the following (weak-sense) reconstruction formula (or co- 
herent state expansion,) holds: 



¥> = / {r]x\p)r]xdp,(x) . 

Jx 



(2.10) 



Equivalently, we obtain the resolution of the identity as a weak operator 
integral 



/ MiVxldp-ix) = l&n 
Jx 



( 2 . 11 ) 



Proof. Recall that by the defining relation (2.7) the right hand side of (2.10) 
denotes the Hilbert space element if € H satisfying for all z £H the equation 



(tM) = / (<p, r] x )(r] x , z)dy(x) . 

Jx 

But the right-hand side of this equation is just {V r) ip,V r) z)\ J 2(x) = {p^z), by 
the isometry property of V n . Hence if — ip. Equation (2.11) is just a rephrasing 
of (2.10). 

As a special case of (2.10) we retrieve (2.6) (with a somewhat weaker sense 
of convergence), observing that by (2.5) ONB’s are admissible coherent state 
systems. Next we identify the ranges of coefficient mappings. 

Proposition 2.12. Let (rj x ) X £x be an admissible coherent state system. Then 
the image space K, = V v ((H) C L 2 (A, /i) is a reproducing kernel Hilbert, space, 
i.e., the projection P onto K. is given by 



PF(x) = [ F(y)(r] v ,r] x )dn(y) . 

Jx 

Proof. Note that the integral converges absolutely since V v (riy) € L 2 (X). If 
we assume that V v is an isometry, then P = V^V*. Plugging in (2.8) gives the 
desired equation: 



v v v;f(x) = (v;f, V x ) 

= / F(y)(rj y ,rj x )diJ,(y) . 
Jx 



2.3 Continuous Wavelet Transforms and the Regular 
Representation 

We now introduce the particular class of coherent state expansions associated 
to group representations which this book studies in detail. We first exhibit 
the close relation to the regular representation of the group. After that we 
investigate the functional-analytic basics of the coefficient operators in this 
setting, i.e., domains and adjoints. 
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Definition 2.13. Let (7 T,H n ) denote a strongly continuous unitary represen- 
tation of the locally compact group G. In the following, we endow G with left 
Haar measure. Associate to 77 € Tt n the orbit ( r] x )xGG = (tt( x)rf) x eG ■ This is 
clearly a coherent state system in the sense of Definition 2.7(a), in particular 
the coefficient operators V v can be defined according to 2.7(b). 

(a) 77 is called admissible iff (-K(x)rj) x ^G is admissible. 

(b) If rj is admissible, then V v : H* L 2 (G) is called (generalized) con- 
tinuous wavelet transform. 

(c) 77 is called a bounded vector ifV v : TL ^ — > L 2 (G) is bounded on Tt n . 

We note in passing that i] is cyclic iff V n , this time viewed as an operator 
Htt — > Gi(G), is injective: Indeed, V v ip = 0 iff ip±n(G)r] , and that is equivalent 
to the fact that ip is orthogonal to the subspace spanned by ir(G)r}. 

A straightforward but important consequence of the definitions is that 

Vr,{n(x)ip)(y) = (tt{x)p, 77(77)77) = (ip,T:(x~ 1 y)r]) = {y v ip)(x^ l y) , ( 2 . 12 ) 

i.e., coefficient operators intertwine 7r with the action by left translations on 
the argument. The same calculation shows that dom(14 ) ) is invariant under 7r. 

Our next aim is to shift the focus from general representations of G to 
subrepresentations of A a- For this purpose the following simple proposition 
concerning the action of the commuting algebra on admissible (resp. bounded, 
cyclic) vectors is useful. 

Proposition 2.14. Let (n,Ttn) be a representation of G and 77 G H n . If T £ 
7r(Gy, then 

V Tv = V v oT* . (2.13) 

In particular, suppose that K, is an invariant closed subspace of H^, with 
projection Pic- If 77 £ Tt n is admissible (resp. bounded or cyclic) for (7 
then Pier] has the same property for ( 77 1 jt,/C). 

Proof. Vr v ip(x) = (ip,ir(x)Tr]) = (T*ip,Tr(x)r]) shows (2.13), in particular the 
natural domain oiV v oT* coincides with dom(Vrj ) ). As a consequence Vp KTj 
is the restriction of to tC. The remaining statements are immediate from 
this: The restriction of an isometry (resp. bounded or injective operator) has 
the same property. 

The following rather obvious fact, which follows from similar arguments, 
will be used repeatedly. 

Corollary 2.15. Let T be a unitary operator intertwining the representations 
7 r and a. Then 77 G TL^ is admissible (cyclic, bounded) iff Tr] has the same 
property. 

We will next exhibit the central role of the regular representation for 
wavelet transforms. In view of the intertwining property (2.12), the remaining 
problems have more to do with functional analysis. The chief tool for this is 
the generalization of Schur’s lemma given in 1.2. 
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Proposition 2.16. (a) If tt has a cyclic vector p for which V v is densely 
defined, there exists an isometric intertwining operator T : Tt n L 2 (G). 
Hence tt < Xg- 

(b) If ip G Hn is such that V v : Tl n — > L 2 (G) is a topological embedding, there 
exists an admissible vector p G Tt^ . 

(c) Suppose that p is admissible and define Tt = V v (Tt v ). Then Tt C L 2 (G) 
is a closed, leftinvariant subspace, and the projection onto Tt is given by 
right convolution with V n p. 

Proof. For part (a) note that by assumption V v is densely defined, and it 
intertwines n and Xq on its domain, by (2.12). Hence Lemma 1.2 applies. 
Since 77 is cyclic, kerF), = 0, yielding 7 r < A a- 

For ( 6 ) define U = V*V v and 77 = C 7 _ 1 / 2 (/ 3 . Note that by assumption U is a 
selfadjoint bounded operator with bounded inverse, hence U ^ 1 / 2 is bounded 
also. Moreover, U G 7 r(G)', hence 1.4 implies U~ 1/f2 G tt(G)'. 

Then by (2.13), V*V v = U~ 1 ^ 2 UU~ 1/ ' 2 = Id-^„. The statements in (c) are 
obvious; for the calculation of the projection confer Proposition 2.12. 

The proposition shows that up to unitary equivalence all representations 
of interest are subrepresentations of the left regular representation. In this 
setting, wavelet transforms are right convolution operators. We next want to 
discuss adjoint operators in this setting. Before we do this, we need to insert 
a small lemma. 

Lemma 2.17. Let a be a measurable bounded function, b G L 2 (G) such that 
for all g G L^G) nL 2 (G), 



/ a(x)g(x)dx = (b,g) . 

Jg 

Then g = f almost everywhere. 

Proof. Assuming that a and b differ on a Borel set M of positive, finite mea- 
sure, we find a measurable function g supported on M, with modulus 1 and 
such that g(x)(b(x) — a(x)) > 0 on M. But then g G L 1 (G) flL 2 (G) yields the 
desired contradiction. 

Remark 2.18. The nontrivial aspect of this lemma is that its proof is not 
just a density argument. Initially it is not even clear whether a is square- 
integrable. For this type of argument, replacing L 1 (G) lTL 2 (G) by some dense 
subspace generally does not work, as the following example shows: Consider 
the constant function a(x) = 1 on G and the subspace Tt = {g G L 1 (G) IT 
L 2 (G) : f G g(x)dx = 0} C L 2 (G). Tt is dense if G is noncompact, and for all 

g g Tt, 

/ g(x)a(x)dx = 0 , 

J R 

with absolute convergence, but of course a^OG L 2 (R). 
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One of the reasons we single this argument out is that we will meet it 
again in connection with the Plancherel Inversion Theorem 4.15. 

Proposition 2.19. Suppose that f G L 2 (G). 

(a) Vf : L 2 (G) — > L 2 (G) is a closed operator with domain 

dom (V f ) = {g G L 2 (G) : g * f* G L 2 (G)} , 

and acts by Vjg = g * f* ■ The subspace dom(V/) is invariant under left 
translations. 

(b) If fA~ 1 ^ 2 G L 1 (G), then f is a bounded vector, with ||V/|| < ||/Z\“ 1 / 2 ||i. 
This holds in particular when f has compact support.. 

(c) Iff* G L 2 (G) then L 1 (G) n L 2 (G) C dom(Vf). 

(d) Suppose that f* G L 2 (G). Then Vf C Vf. If one of the operators is 
bounded, so is the other, and they coincide. 

Proof. The first part of (a) was shown in Proposition 2.8. V/g = g * f* was 
observed in equation (2.4). (b) and (c) are nonabelian versions of Young’s 
inequality. We prove (b) along the lines of [45, Proposition 2.39], the proof of 
part (c) is similar (and can be found in [45]). We write 



g * f*(x) = [ g(y)f(x~ 1 y)dy 
Jg 

= / g(xy)f(y)dy 
Jg 

= f {R v g){x)f{y)dy , 

Jg 

where ( R y g)(x ) = g{xy). An application of the generalized Minkowski in- 
equality then yields 

lls*/*l|2< [ \\R v gh\f(y)\dy = [ \\g\\ 2 A G (y)- 1/2 \f(y)\dy 
Jg Jg 

= || 5 || 2 ||/Z\- 1/2 || 1 . 

For the computation of the adjoint operator in (d), let g G dom(Vj). For 
all h G L 1 (G) n L 2 (G) C dom(V/), we note that 

[ [ \hfx)f(y- 1 x)g(y)\dydx< f \h(x)\\\f*\\ 2 \\g\\ 2 dx < oo , 

J g J g Jg 



hence we may apply Fubini’s theorem to compute 
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{h, Vjg) = ( V f h,g ) 

= / / h(x)f(y~ 1 x)dxg{y)dy 

Jg Jg 

= / K x ) / g(y)f(y~ lx ) d ydx 
Jg Jg 

= f Hx) [ g(y)f*(x~ 1 y)dydx 
Jg Jg 

= / h(x)Vf g(x)dx 
Jg 



Note that Vf*g here denotes the coefficient function as an element of Cb(G ); 
we have yet to establish that g £ dom(hy*. Here Lemma 2.17 applies to prove 
Vf*g = Vj g £ L 2 (G) and thus Vf c Vf. Assuming that Vf is bounded, 
it follows that Vf D Vf is everywhere defined and closed, hence bounded. 
Conversely, Vf being contained in a bounded operator clearly implies that Vf 
is bounded. 



Remark 2.20. Part (c) of the proposition implies that Vf is densely defined 
for arbitrary / £ L 2 (G), when G is unimodular. This need not be true in the 
nonunimodular case, see example 2.29 below. 

We note the following existence theorem for bounded cyclic vectors. 

Theorem 2.21. There exists a bounded cyclic vector for Xq- Hence, an arbi- 
trary representation n has a bounded cyclic vector iff tt < Xg- 

Proof. Losert and Rindler [84] proved for arbitrary locally compact groups 
the following statement: There exists / £ C c (G) which is a cyclic vector for 
A a iff G is first countable. Thus second countable groups have a cyclic vector 
/ € C c (G). But then 2.19 (b) entails that Vf is bounded on L 2 (G), i.e. / is 
a bounded cyclic vector for L 2 (G). Propositions 2.14 and 2.16 (a) yield the 
second statement. 



Remark 2.22. When dealing with subrepresentations 7Ti < 7T2 and a vector 
y € Ti ni C Hk 2 , the notation V v is somewhat ambiguous. Nonetheless, we 
refrain from introducing extra notation, since no serious confusion can occur: 
Denoting VW for the operator on Ti Vi (i = 1, 2), we find that Vff 2 = Vff 1 on 
H ni , and Vff 2 = 0 on 74^ . Hence Vff 2 is just the trivial extension of Vff 1 . 

We close the section with a first short discussion of direct sum represen- 
tations. 

Proposition 2.23. Let tt = ©i£j 7T.;, and ?y £TL. Let Pi denote the projection 
onto Ti Vi , and gi = Pig. Then the following are equivalent: 

(a) y is admissible. 
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(b) rji := PiT] is admissible for 7T», for all i £ I, and Im(V^ i )±Im(V^ ;) . ), for all 
i ^ 3- 

Proof For (a) => (6), the admissibility of //, is due to Proposition 2.14. More- 
over, if 14; is isometric, then it respects scalar products; in particular, the 
pairwise orthogonal subspaces {Pi(TC))i^i have orthogonal images. But since 
14, o Pi = V m , this is precisely the second condition. The converse direction is 
similar. 

One way of ensuring the pairwise orthogonality of image spaces in part (6) 
of the proposition is to choose the representations 7Tj as pairwise disjoint: 

Lemma 2.24. Let 7Ti and tt 2 be disjoint representations, and rji £ Tin, be 
bounded vectors (i = 1,2). Then V m (7i Wl )_L14, 2 (W^) in L 2 (G). 

Proof. 14* Id,, : dd Wl Id 7 f 2 is an intertwining operator, hence zero. Therefore, 

for all ipi £ Tt Vl and ip 2 € Tt^ 2 , 

0 = (K2 V m V11T2) = (V m tpi , 14, 2 (p 2 ) , 

which is the desired orthogonality relation. 



2.4 Discrete Series Representations 

The major part of this book is concerned with the following two questions: 

• Which representations n have admissible vectors? 

• How can the admissible vectors be characterized? 

For irreducible representations (such as the above mentioned examples), these 
questions have been answered by Grossmann, Morlet and Paul [60]; the key 
results can already be found in [38]. Irreducible subrepresentations of Xq are 
called discrete series representations. The complete characterization of 
admissible vectors is contained in the following theorem. We will not present 
a full proof here, since the theorem is a special case of the more general results 
proved later on. However, some of the aspects of more general phenomena 
encountered later on can be studied here in a somewhat simpler setting, and 
we will focus on these. 

Theorem 2.25. Let tt be an irreducible representation of G. 

(a) 7 r has admissible vectors iff tt < Xq- 

(b) A nonzero 77 £ TL „ is admissible (up to normalization) if V^ij £ L 2 (G), or 
equivalently, if £ L 2 (G), for some nonzero £ Tt 
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(c) There exists a unique, densely defined positive operator C w with densely 
defined inverse, such that 

r) G H n is admissible rj G dom(C' w ), with ||C , , r ? 7 || = 1 . (2.14) 

This condition follows from the orthogonality relation 

(C^ri',C^r))(p,p') = (V n <p,V v ><p') , (2.15) 

which holds for all p,p' G Tii, and rj,r f G dom(C 7r ). Conversely, V^p $ 
L 2 (G) whenever if) £ dom(C n ) and 0 ^ ip G TL^. 

(c) Ctt = c n x Id h, for a suitable > 0 iff G is unimodular, or equivalently, 
if every nonzero vector is admissible up to normalization. 

(d) Up to normalization, C „ is uniquely characterized by the semi-invariance 
relation 

tt(x)C^tt(x)* = A G (x) 1/2 C 7r ■ (2.16) 

The normalization of C n is fixed by (2.15). 

Proof. The ”only-if” part of (a) is noted in Proposition 2.16 (a). For the 
converse direction assume ir < X G , w.l.o.g. n acts by left translation on a 
closed subspace of L 2 (G). Then projecting any rj G G C (G) into H n yields 
a bounded vector, by 2.19(b) and 2.14. Since G C (G) is dense in L 2 (G), we 
thus obtain a nonzero bounded vector 77 . Since n is irreducible, it follows that 
V v is isometric up to a constant (by Lemma 1.2), hence we have found the 
admissible vector. 

For the proof of part (b) note that the following chain of implications is 
trivial: 

77 is admissible up to normalization =4> V v rj G L 2 (G) 

=$■ (3</? G U n \ {0} : Vrjip G L 2 (G)) . 

For the converse direction, assume V r) p G L 2 (G) for a nonzero ip. Then 
dom(V r T/ ) is nonzero and invariant, hence it is dense by irreducibility of it. 
But then Lemma 1.2 applies to yield that V rl is isometric up to a constant. 
Since ^ 0, the constant is nonzero, and thus 77 is admissible up to nor- 
malization. 

The construction of the operators G^ requires additional tools from func- 
tional analysis. The basic idea is the following: Fix a normalized vector ip G TL n 
and consider the positive definite sesquilinear form 

B v ■■ ( 77 , r? 7 ) i-> {V v >ip,V v ip) , 

which is the right hand side of (2.15) for the special case that p = p' . The 
domain of this form is T> x T>, where T> is the space of vectors 77 which are 
admissible up to normalization. Note that T) is dense, being nonzero and 
invariant. 
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Recalling from linear algebra the representation theorem establishing a 
close connection between quadratic forms and symmetric matrices, we are 
looking for a positive selfadjoint operator A such that 

B v (v,V ') = {Ar),v') , 

and then letting C n = A 1 / 2 should do the trick. Here we are in the situation 
that the domain is only a dense subset. We intend to use the representation 
theorem [101, Theorem VIII. 6 ], and for this we need to show that B v is 
closed. This amounts to checking the following condition, for every sequence 
(Vn)ne n and i] G Ti n such that r/ n — > 77 : If 

B v {rj n - r]m,r] n ~ Vm) — ► 0 , as n,m— ► 00 (2.17) 

then 77 G V and B v (ri n — 77 , 77 n — 77 ) — > 0. It turns out that this is precisely the 
argument from the proof of Proposition 2.8: Observing that 

l',V~v') = \\V v - v ><p\\l= WVnV-Vn'ipWl , 

we see that condition (2.17) is equivalent to saying that (V rln p) ne f>s is a Cauchy 
sequence in L 2 (G) . Hence after passing to a suitable subsequence we find that 
V Vn p ~ > F G L 2 (G), both in L 2 and pointwise almost everywhere. On the 
other hand, r] n — > 77 entails V rln p — > V q (p uniformly, by Cauchy-Schwarz. 
Hence F = V v , and 77 G V by part (a). Therefore we obtain the operator A, 
and letting Cn = A 1 / 2 yields 

(V v '<p, Vncp) = {CnV, Cnv') (2.18) 

The hrst step for deriving the general orthogonality relations consists in 
observing that B v (and consequently Cn) is independent of the choice of 
normed vector ip: Fixing an arbitrary admissible 77 , the fact that V v is the 
multiple of an isometry yields for all normed ip 

B V {V,V) = \\V v <p\\2 = Cn\M 2 

where is a constant independent of p. By polarization this implies that 
B v is independent of p. Hence we obtain for arbitrary ipG TL and admissible 
vectors 77 , 77 ' 

ly v rp, V v ip) = \\p\\ 2 (CnV,Cn7l) ■ 

Polarization with respect to p yields (2.15). 

Part (c) follows from (d), for (d) we refer to [38]. 

We note that (2.16) entails that Cn is unbounded in the nonunimodular 
case, since the operator norm on B(Tin) is invariant under conjugation with 
unitaries. The operators Cn are called Duflo-Moore operators. More details 
on these operators can be found in Section 3.8. The proof given here basically 
follows the argument in [60] . The main reason we have reproduced it in part is 
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to demonstrate the close connection between the admissibility condition and 
the construction of the operators: The admissibility criterion (2.14) implies the 
orthogonality criterion (2.15) by polarization, and the latter was used to define 
CV Let us also point out the crucial role of irreducibility, which particularly 
implies that the space of admissible vectors (up to normalization) is dense in 

n n . 

Remark 2.26. Note that the Duflo-Moore operators C studied here relate to 
the formal dimension operators K~ in [38] as 1 2 = CL . The terminol- 
ogy ’’formal dimension operator” is best understood by considering compact 
groups: Let n be an irreducible representation of a compact group G. Since 
coordinate functions are bounded, it is obvious that 7r is square-integrable. G 
is unimodular, thus C V is scalar. Now the Schur orthogonality relations for 
compact groups [45, 5.8] yield for a normalized vector <p that 

\\vM\l = d ^M\ 2 

1 /o 

where d n = dim(7t^.). Thus C n = d n ■ Tt^, and the formal dimension 

operator K n = C~ 2 is multiplication with the Hilbert space dimension of 7 i.^. 

The theorem of Grossmann, Morlet and Paul provides a rich reservoir 
of cases. In fact the large majority of papers dealing with the construction of 
wavelet transforms refers to this result. We give a small sample which contains 
the most popular examples. 

Example 2.27. Windowed Fourier transform. Consider the reduced 
Heisenberg group, given as the set H r = R 2 x T, with the group law 

(P, Q, z)(p\ q', z’) = (p + p', q + q', zz > e ™W-«/)) . 

Haar measure here is given by dpdqdz , where dz is the rotation-invariant 
measure on the torus, normalized to one. G is unimodular. It acts on L 2 (R) 

via the Schrodinger representation given by 

(Tr(p,q,z)f)(x) = ze 2mqix+p/2) f(x+p) . (2.19) 

Straightforward calculation allows to establish that 



f [ [ [ g(x)ze~ 2 ^ x+p/2) p(x + p)dx dzdqdp 

M g{x)e~ 2 ^ q{x+p/2) i 1 {x + p)dx dqdp 

[ 

[ [ [ g(x)e~ 2mqx ij(x + p)dx dqdp 

Jr Jr Jr 



\H p (q)\ 2 dpdq , 
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where H p (x) = g(x)g(x + p), which for fixed p £ R. is an integrable function. 
An application of Fubini’s and Plancherel’s theorem for the reals yields 



\H p (q)\ 2 dpdq = 



\g{x)g{x + p)\ 2 dxdp 



= MthWl 



This relation implies first of all that 7r is irreducible: V v is injective for every 
nonzero 77 , i.e., g is cyclic. Moreover, every g £ L 2 (R) is admissible up to 
normalization; more precisely, iff ||? 7 || = 1. This is what we are to expect by 
Theorem 2.25: G is unimodular, hence the formal dimension operator is a 
scalar multiple of the identity. In addition, we have established by elementary 
calculation that the scalar equals one. 

Since the torus acts by multiplication, we have \ Vf(p,q,z)\ = \Vf(p,q,l)\, 
for all z £ T. Hence the map W/ : g 1-7 (P/gOln^x-ti} is isometric as well. Wf 
is the windowed Fourier transform associated to the window /. 

Hence we have derived for all / £ L 2 (R) with ||/|| = 1 the transform 

W f g(p,q) = f g(x)e 2 ^ x+ P^f(x+p) dx , 

Jr 

with inversion formula 

9{x)= [ [ W f g(p,q) e- 2 ^ x+p Wf(x+p) dpdq . 

Jr Jr 

Note that this inversion is to be understood in the weak sense and usually 
does not hold pointwise. 

Example 2.28. 1-D CWT. This is the original “continuous wavelet trans- 
form” introduced in [60]. It is based on the ax + b group, the semidirect 
product K xi K'. As a set G is given as G = R x R', with group law 

( b , a)(b ' , a') = (b + ab 1 , aa ' ) . 

The left Haar measure is d6|a|~ 2 <ia, which is distinct from the right Haar 
measure db\a\~ 1 da. Wavelets arise from the quasi-regular representation 
7T acting on L 2 (R) via 



(n(b,a)f){x) = \a\ 1/2 f ■ 

Again, computing L-norms of wavelet coefficients turns out to be an exercise 
in real Fourier analysis. First observe that on the Fourier transform side 7 r 
acts as 

(7r(6,a)/) A (o;) = |o| 1 / 2 e- 2wi “ 6 /(aw) 

Hence, using the Plancherel theorem for the reals we can compute 
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V v g\\ 2 = / \(g,n(b,a)r))\~ dn G (b,a) 



/ \{g, a)?y) A )| 2 dfiG(b, a) 

JG 

[ [ [ f{l)\a\ 1/2 e 2mlb r)(a'))d'y 
J J R J R 



a I 2 dbda 



/( 7 )e 2 ^Y ? (a 7 )d 7 



'R fc 



I 1 dbda 






1 dbda, 



where </> a ( 7 ) = 3(7)57(07). The Planclrerel theorem allows thus to continue 




|a| 1 dbda 



3(7)3(07) l«| 1 dbda 



= [ 13(7) I 2 ( [ |3(o 7) I 2 M d 7 

7r \3r' / 

= ^|3(7)| 2 ^ • l3(a7)| 2 |ar 1 doj 

= c 2 ||3l| 2 , 



where we used the fact that the measure a Ma is Haar measure of the mul- 
tiplicative group R'. Hence we have derived 



\Kg\\l 



IIMI 5 



( 2 . 20 ) 



where 




( 2 . 21 ) 



Note that our calculations also include the case c v = 00, where (2.20) means 
that V v f L 2 (G). For this additional observation we need the following ex- 

tended version of the Planclrerel theorem: 



V/i € L 1 (M) 




h G L 2 (]R 




(2.22) 



Now “=>” is due to Planclrerel’s theorem, but the other direction is not. In 
order to show it, let g G L 2 (R) denote the inverse Planclrerel transform of h, 
we have to show g = h. But this follows from the injectivity of the Fourier 
transform on the space of tempered distributions, since restriction to L 1 (G) 
resp. L 2 (G) yields the Fourier- resp. Planclrerel transform. 

As in the case of the windowed Fourier transform, (2.20) implies that the 
representation is irreducible. This time, the admissibility condition reads as: 



?7 G L 2 (R) is admissible <t=> c v = 1 . 



(2.23) 
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Comparing our findings to Theorem 2.25, we see that we have a discrete 
series representation of a nonunimodular group. Accordingly, the admissibility 
condition is more restrictive, requiring not just the right normalization. As 
a matter of fact, it is straightforward to check the semi-invariance relation 
(2.16) to show that the Duflo-Moore operator is given by 

(H/) A H = M _1/2 /H , 



as ( 2 . 21 ) suggests. 

Example 2.29. As observed in Remark (2.20) above, Vf need not be densely 
defined for arbitrary / £ L 2 (G), when G is nonunimodular. Here we construct 
such an example for the case that G is the ax + &-group. For this purpose con- 
sider the quasi-regular representation 7 r from Example 2.28. Pick a ip £ L 2 (R) 
which is not in the domain of the Duflo-Moore operator, and an admissible 
vector g. Defining / = and H = 14 )(L 2 (R)) c L 2 (G), we see that Vfg = 0 
for g £ 7i ± , whereas for g = V^ip £ H, 

Vfg{x ) = (V v ip, \g{x)V v i/j) = {<p,-?r(x)ip) = V^x) , 

and the latter function is not in L 2 (G) by 2.25 (b) and the choice of ip- Hence 
dom(Vy) = and Vf = 0 on this domain. 

Example 2.30. 2-D CWT. This construction was first introduced by Murenzi 
[93], as a natural generalization of the continuous transform in one dimension. 
We consider the similitude group G = JR 2 x (SO( 2) x 1R+). Hence G is the 
set K 2 x SO( 2) x ]R + with the group law 

(x,h,r)(x' ,h' ,r) = {x + rhx' , hh! , rr') . 



The group can be identified with the subgroup of the full affine group of the 
plane generated the translations, the rotations and the dilations. It thus acts 
naturally on R 2 , which gives rise to the quasi-regular representation n acting 
on L 2 (R 2 ) via 

(tt(x, h , r)f){y) = |r| _1 /(r _1 /i _1 (y - x)) . 



An adaptation of the argument for the ID CWT yields 



where this time 



c v = 



V v f\\l = cl\\f\\ 2 

r I/HI 2 



du> . 



uj l 



Therefore the admissibility condition reads 



/' I/HP 

I I I o 



■du> = 1 . 



(2.24) 



77 is admissible 
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As in the case of the 1D-CWT, we obtain from the norm equality that 7r is 
again irreducible. The Duflo-Moore operator is computed as 

(<?„/)» = m-7m . 



Next let us consider direct sums of discrete series representations. The 
following theorem describes how far the discrete series arguments carry. Recall 
that Proposition 2.23 gives criteria for direct sum representations, and the 
orthogonality relations for the discrete series case allow to derive admissibility 
criteria for multiplicities greater than one. 

Theorem 2.31. Let x = © j;G jXj, where each x,; is a discrete series represen- 
tation. Denote by Pi the projection onto the representation space 7 i. 7Ti , and by 
C 7Vi the associated Duflo-Moore operators. Since the 7 r* are irreducible, there 
exist (up to normalization) unique intertwining operators Sij : H. Vi — -> TL nj ■ 
Then the following are equivalent: 

(a) T] is admissible. 

(b) ip € dom(C Wi ), with 1 1 C' 7 ri 77 ^ 1 1 = 1. Moreover, for all i,j with 7 t* ~ 7 ij, 

[(', S;. ^Jii) 0 (2.25) 



Proof. We apply Proposition 2.23. By Theorem 2.25(c), ||C' 7ri 77j|| = 1 is the ad- 
missibility condition on ip. Moreover, the orthogonality relation (2.15) shows 
that whenever x; ~ ttj, 

lm(V rii )Um.(V m ) ■$=> (C nj Si tj r}i,C nj r}j) = 0 . 

Since any two irreducible representations are either equivalent or disjoint, 
Lemma 2.24 yields Im(V) ?i )TIm(V) )i ) for arbitrary vectors ip and r/j, whenever 
x,; qf. TTj. Hence the proof is finished. 

The following remark is a preliminary version of one of the main results 
contained in this book: The existence criterion for admissible vectors given 
in Theorem 4.22. Here we only consider the case of direct sums of discrete 
series representations. Some of the phenomena encountered in the general case 
can be already examined in this simpler setting, in particular the striking 
difference between unimodular and nonunimodular groups and the role of the 
formal dimension operators in this context. 

Remark 2.32. Let x = ©is/ Xj, where each x, is a discrete series represen- 
tation. We associate a multiplicity function : G — > No U{°°} to x, by 
letting 

?n w (cr) = |{i G I : a ~ x j; }| , 
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where | • | denotes cardinality, ra, simply counts the multiplicity with which the 
representation 7r is contained in 7 r. Note that is assumed to be separable, 
hence the cardinalities are countably infinite at most, and only countably 
many er have a nonzero multiplicity. Fix unitary intertwining operators T, : 
H ni — y Hu, for the unique er £ G with er ~ 7 q. The uniqueness property of 
the Duflo-Moore operators entails that C G = TjC^T*. 

Using the operators Tj, the admissibility conditions from Theorem 2.31 
can also be written as 



(CuT lV i,CuT jVj ) = 0 (7T-i — 7Tj ) (2.26) 

11^11 = 1 (ViG/) (2.27) 

Both relations can be used to derive necessary conditions for the multiplicity 
function: (2.26) clearly implies that 

m T (cr) < dim(7i 0 -) . (2.28) 

Moreover, the orthogonal decomposition of H n yields in particular that 

«>>ni 2 = X)w 2 = Ew 2 • ( 2 - 29 ) 

i£l i£l 

Now assume that G is unimodular. Then C„ = c„ x Id u^, with positive scalars 
Cu . Hence (2.27) entails the necessary condition 

m n (a)c~ 2 < 00 . (2.30) 

o-eG 

Conversely, it is easily seen that vectors fulfilling (2.26) and (2.27) exist 
once (2.28) and (2.30) hold, therefore we have found a characterization of 
direct sums of discrete series representations with admissible vectors. Note 
that (2.30) implies m n (a) < 00 , which can be seen as a sharpening of (2.28). 

In the nonunimodular case the situation is much less transparent. However, 
it turns out that the restrictions actually vanish! To begin with, dim(7-f 0 .) = 00 
follows from the existence of an unbounded operator Cu on H a - In addition, 
while (2.29) still holds, implying in particular that (at least for I infinite) the 
norms of the 77 \ become arbitrarily small, it is no contradiction to (2.27). Here 
the fact that the C ni are unbounded makes it conceivable that there exist 
vectors that actually fulfill both conditions. Note that we still need to ensure 
(2.26), which requires more knowledge of the formal dimension operators than 
we have currently at our disposal. In any case the existence of an unbounded 
operator on H a entails dim(7Y cr ) = 00 , i.e., (2.28) holds trivially. 

We will next study the space L 2 (G) spanned by all coefficient functions 
associated to a fixed discrete series representation tt. Most of the following 
is due to Duflo and Moore. The results can be seen as precursors of the 
Planclrerel formula, or more precisely, as the contribution of the discrete series 
to the Planclrerel formula. They also provide further insight into the role of 
Hilbert-Sclrmidt operators and the quasi-invariance relation (2.16). 
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Theorem 2.33. Let n be a discrete series representation, and define 
L l( G ) = span{'H : A g |h ~ tt} . 

(a) L 2 (G) = span{F^ : ip,g £ H n such that V v ip £ L 2 (G)}. 

(b) L 2 (G) is A g x QG -invariant, with A G x ,o G |l 2 (G) — Trig) W. In particular, 
A G x Pg|l 2 (G) is irreducible. 

(c) Let (r]i)i£i denote an ONB of H n contained in dom(G“ 1 ). Then 

( V C^ 1 r H 1 h) is aH 0NB °f L l( G )- 

(d) If a is another discrete series representation with a qk n, then L 2 (G)_L 

L 1(G)- 

Proof. For part (a) we let Hq = spanjV^iyj ; V £ H n , r\ is admissible}. Then 
for every / = V rl ip £ Ho, the leftinvariant space spanned by / is just the image 
of H n under V v , which is a unitary equivalence. Hence Ho C L^.(G), which 
extends to the closure of Ho . 

For the other direction we argue indirectly. Assume that there exists g £ 
L 2 (G) such that the restriction of A G to the leftinvariant subspace generated 
by g is equivalent to 7r, yet g is not contained in the closed span of Ho- W.l.o.g. 
we may assume that gl-Ho- Observe that Hq is rightinvariant also, since 

V-K(x)r,v{y) = (V,n(yx)r)) = Ag(x )~ 1/2 (pg{x)V v <p) ( : y ) . 

Let Q denote the projection onto the leftinvariant space generated by g. Pick 
h £ G C (G) such that Qh ^ 0. Then we have 

VQh,g = Vhg = g *h* £ L 2 (G) 

by choice of h and 2.19 (b). Moreover, VQhg is nonzero since Qh and g are 
nonzero and 7r is irreducible. By definition of Hq we have VQhg £ calHo- On 
the other hand, rightinvariance of Ho yields that if gl-Ho, then g * h* 1-Ho, 
and we have the desired contradiction. 

For part (6), consider the mapping 

T : ip®r] i-> V c -i v ip , 

defined for all elementary tensors satisfying g € dom(G“ 1 ). Since C~ x is 
densely defined, these tensors span a dense subspace of H^®Ht,. Moreover, by 
the orthogonality relation (2.15), T is isometric. Hence there exists a unique 
linear isometry, also denoted by T : H n (g> H n —> L 2 (G). By part (a), it 
has dense image, hence T is in fact unitary. We will next show that T is an 
intertwining operator. For this purpose observe that (2.16) gives rise to 

7 r(a;)G“ 1 7r(a;)* = 2 A G (a;) _1/2 G“ 1 . 



Then we compute 
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TO® n(x)r])(y) = (ip,n(y)C^ 1 n{x)r]} 

= (t, AsVyMTO" 1 ??) 

= A G (x) 1/2 T(ip ® ir)(yx) 

= (Q(T(<p® n)) (y) . 

This shows that T intertwines 1 ® W with g G ; the left half is obvious. 

Now part (c) is obtained by applying T to the ONB ( 77 * ® Vj)i,jef- Part 
(d) follows from (a) and 2.24. 

Observe that an ONB as in part (c) of the theorem always exists, since 
dom(C'“ 1 ) is dense; simply apply Gram-Schmidt orthonormalization. 

We will next show the announced contribution of 7r to the Planclrerel 
formula. For this purpose we need the following definition: For f £ L 1 (G) and 
a representation 7 r, let 



tt(/) = [ f(x)ir(x)dx , 

JG 

where convergence is in the weak sense, which for / £ L 1 (G) is guaranteed. 
This construction will be seen to yield the operator- valued Fourier trans- 
form, which is discussed in more detail in Chapter 3. We postpone a more 
complete discussion of the Fourier transform to that chapter, and only show 
the following result. 

Theorem 2.34. Let n be a discrete series representation. Denote by P v the 
projection onto L 2 (G). Then, for all f £ L 1 (G) DL 2 (G), 7 r(/)G“ 1 extends to 
a Hilbert- Schmidt operator, with 

II 7r(/)G~ 1 1| = ||T > 7 t(/)|| • 

Proof. Let an ONB (%)*£/ C dom(G“ 1 ) of H n be given. Then by part (c) of 
the previous theorem, we can compute the norm of Pn(f) as 

ll^(/)ll 2 = E I 2 




= E I W) c -K 1 Vj,Vi )\ 2 

i,jei 



where the last equation used the definition of the weak operator integral. But 
the last term is just the Hilbert-Schmidt norm of 7 r(/)G“ 1 . 

Let us now give a few examples for which the discrete series approach can- 
not work. Clearly, if the underlying group is compact, then every irreducible 
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representation is in the discrete series: Wavelet coefficients are bounded func- 
tions and the Haar measure is finite, hence every wavelet coefficient is trivially 
in L 2 . At the other end of the scale we have the reals: Every irreducible rep- 
resentation is a character, i.e. a group homomorphism R — » T. Matrix coeffi- 
cients are constant multiples of that character, hence never square-integrable. 
The following theorem extends this observation to a larger class. The result 
is probably folklore, though I am not aware of a reference. 

Theorem 2.35. Let G be a SIN-group, i.e., every neighborhood of unity 
contains a conjugation-invariant neighborhood. If G has a discrete series rep- 
resentation, then G is compact. 

In particular, if G is discrete and has a discrete series representation, then 
G is finite. If G is abelian and has a discrete series representation, then G is 
compact. 

Proof. Note that SIN-groups are unimodular: For any conjugation-invariant 
neighborhood U of unity, and any x £ G we have \Ux\ = \x~ 1 Ux\ = \U\. 

Now let 7T be a discrete series representation. The first step consists in 
showing that dim(7i, r ) is finite. For this purpose pick a conjugation-invariant 
neighborhood of unity such that 7r(l[/) yf 0. The existence of such a neighbor- 
hood is seen as follows: Since the characteristic functions of a neighborhood 
base at unity span a dense subspace of L 1 (G), we would otherwise obtain 
tt (/) = 0 for all / £ L 1 (G). This would contradict [35, 13.3.1], hence U exists. 

We next show that 7r(ljy) is an intertwining operator. Using conjugation- 
invariance of U and rightinvariance of Haar measure, we find 



<(/>, 7 T (lc/) tt(2/)?7) = / lu(x)((j), n(x) , K(y)r]}dfiG(x) 

JG 

= / (< t>,n(xy)rj)dp,G{x ) 

Ju 

= / (< p,Tt{x)rj)dp, G {x ) 

JUy 

= / {<t ) ,n{x)ri)dp.G{x) 

JyU 

= / (' <t>,n{yx)ri)dp, G {x ) 

Ju 

= {&,Tr{y)ir (lu)v)- 



Hence, by Schur’s lemma, 7r(ljy) is a scalar, which is nonzero by choice of 1 jj. 
On the other hand, 7r(l[/) is Hilbert-Sclnnidt. Hence dim(Tf^) < oo. 

Now assume that G is not compact. Since G is cr-compact and locally 
compact, there is a sequence (G„)„ 6 n of compact sets in G with the property 
that A c G is compact iff there exists n £ N such that A c C n . Pick a 
sequence (a: n )nGN C G with x n £ G \ C n . Then for every compact set A C G 
there exists ua € N with Xk $. C for all k > ha, and this property is inherited 
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by subsequences. Since dim(7i 7r ) < oo, we may assume that 7 = C" and 
7 t(G) C U(n). Since U(n ) is compact, passing to a subsequence allows the 
assumption that 7r(x n ) — > S € U(n). Picking any unit vector 77 , we thus arrive 
at 

V v (Sr])(x n ) = (Srj,Tr(x n )rj) -> ||S'??|| 2 = 1 . 

On the other hand, V n (Sr]) vanishes at infinity, by 2.19, which yields the 
desired contradiction. 

Note that the somewhat complicated choice of the sequence x n is only 
made to avoid that any subsequence is relatively compact. 

Let us close with an example that cannot be covered by the results in this 
section. 

Example 2.36. Dyadic wavelet transform. This construction was first con- 
sidered by Mallat and Zhang [92], though without referring to any group 
structure. We consider the group H = R. x Z, where Z acts by powers of 2. 
Hence H is the subgroup of the ax + 6 -group generated by Rx {0} and (0, 2); 
let’s call it the 2 k x + 6 -group. We are interested in admissible vectors for the 
restriction of the quasiregular representation from Example 2.28 to H. An 
easy adaptation of the calculations there yields 

ll^/ll!= / , (2.31) 

Jr 

where the function < 2 ^ is given by 

w = Elavil 2 • 

n£Z 



For the proof of a more general result we refer the reader to Theorem 5.8 
below. 

Unlike the previous examples, this representation is not irreducible: Con- 
sider a function / such that / is supported in [1, 1.5], and p with supp(?)) C 
[1.5, 2]. Then <I> n = 0 on the support of /, and thus (2.31) implies V v f = 0. 

On the other hand, (2.31) yields the admissibility criterion 

p is admissible <P V = 1 , 

and it is easy to construct such functions, say rj = lr_ 2j — ii + 1 [ 1 , 2 ] - Hence 
we have found a representation which is not covered by the discrete series 
case. As a matter of fact, 7 r does not contain irreducible subrepresentation: 
Suppose that H C L 2 (R) is an irreducible subspace. Since 7 r has admissible 
vectors, the subrepresentation also does, by Proposition 2.14. Let 77 G H be 
admissible. Then n(G)rj spans 7Y, therefore relation (2.31) yields that 

Ti 1 - = {(/?€: L 2 (R) : V v <p = 0} 

= W G L 2 (R) : |supp(<£) IT supp(^|) = 0} . 
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But the orthogonal complement of the latter space is easily computed, yielding 

TL = {v? <E L 2 (R) : supp(^) C supp(^)} 

Recall that supp denotes the measure-theoretic support, and inclusion is un- 
derstood up to sets of measure zero. Now it is easy to construct two nonzero 
vectors £1 and £2 such that ^ and <P^ 2 have disjoint supports, both con- 
tained in supp(^). To see this observe that ^(2™w) = <T v (u) implies that 
supp(^) C U ra6 z2"A, where A = [1, 2[nsupp(^,,). In particular, A has pos- 
itive measure. Hence, if we pick B\,B 2 C A disjoint with positive measure, 
and let = 1 s 4 , we obtain two nonzero functions such that supp(^ 1 ) and 
supp(^ 2 ) are disjoint. But then (2.31) implies = 0, in particular £1 is 
not cyclic for TL. 

Thus 7r has no irreducible subrepresentation, in particular Theorem 2.31 
has significance either. 



2.5 Selfadjoint Convolution Idempotents and Support 
Properties 

We now continue the discussion of the subspaces of L 2 ( G ) which arise as im- 
age spaces of wavelet transforms. The following notion describes the associated 
reproducing kernels. After proving this observation, we will draw several con- 
sequences from the properties of the reproducing kernel spaces. In particular, 
we study support properties of wavelet transforms, as well as the existence of 
admissible vectors for A a- 

Definition 2.37. S £ L 2 (G) is called (right selfadjoint) convolution 
idempotent if S = S * S* = S* . 

Convolution idempotents in L 1 (G) have been studied for instance in [59], 
and generally the existence of such idempotents is a strong restriction on 
the group. By contrast, we will see that L-convolution idempotents exist in 
abundance. But first the connection between convolution idempotents and 
generalized wavelet transforms. 

Proposition 2.38. (a) Let S £ L 2 (G) be a convolution idempotent, and de- 
note by TL the closed leftinvariant subspace generated by S, i.e., 7 i = 
span(A g(G)S). Then the projection onto TL is given by right convolution 
with S, i.e. TL = L 2 (G)*S = {g * S : g £ L 2 (G). Moreover, ifT is another 
convolution idempotent in TL with TL = L 2 (G) * T, then T = S. 

(b) S is a selfadjoint convolution idempotent iff there exists a representation 
7T and an admissible g £ TL ^ such that S = V v g. Consequently, the image 
spaces of continuous wavelet transforms are precisely the spaces of the 
form L 2 (G) * S. 
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Proof. For (a) observe that clearly f = f * S holds for all / £ spaii(Ac(G).S'), 
as well as / * S = 0 for all flfH. Hence on a dense subspace Vs = Ph > the 
latter being the projection onto Tt. Since Vs is closed, the result follows. The 
uniqueness statement follows from T = T * S and T = T* , hence 

T = S* * T* = S *T = S . 

The “if” -part of ( b ) is due to 2.16 (c). For the other direction let n be the 
restriction of Xq to Tt = L 2 (G) * S. Then f = f * S = Vsf for / £ Tt shows 
that the inclusion map is a continuous wavelet transform. The last statement 
is obvious by now. 

The next property will be relevant for sampling theorems, allowing to 
conclude uniform convergence from L 2 -convergence. Note that this observation 
holds for a larger class of reproducing kernel Hilbert spaces. 

Proposition 2.39. Let S £ L 2 (G) be a selfadjoint convolution idempotent, 
then for all f GTt = L 2 (G) * S we have ||/||oo < ||/|| 2 ||/S|| 2 - 

Proof. This follows from the Cauchy-Schwarz inequality: 

\f( x )\ = l(/*S*)(:r)| = \{f,Xc(x)S)\ < H/IMI-SHa • 

The following proposition gives rise to a somewhat subtle distinction be- 
tween unimodular and nonunimodular groups: In the unimodular case, any 
invariant subspace of L 2 (G) which has admissible vectors possesses one in the 
form of a convolution idempotent. This will not be the case for nonunimodular 
groups, as will be clarified in Remark 2.43 below. 

Proposition 2.40. Suppose that Tt C L 2 (G) is closed and leftinvariant. As- 
sume that Tt has an admissible vector p with if £ L 2 (G). Then there exists a 
right convolution idempotent S £ Tt such that Tt = L 2 (G) * S. In particular, 
in such a case Tt C Go(G). 

Proof. Suppose that an admissible vector i] £ Tt exists, then the projection 
onto Tt is given by V^V^. Since V v is bounded, 2.19 (d) implies that S = 
rf *p = Vfp*G Tt. Hence, using associativity of convolution, / = (/*? f)*r] = 
f*S, for all / £ Tt, whereas f*{rf*p) = 0, for f \STt. Therefore Tt = L 2 (G)*S', 
and S is the desired selfadjoint convolution idempotent. 

We use the proposition to prove the following result due to Rieffel [102]. 

Proposition 2.41. Let G be a unimodular group and Tt C L 2 (G) a closed, 
leftinvariant subspace. Then Tt contains a nonzero selfadjoint convolution 
idempotent. 
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Proof. We start by choosing a nonzero bounded vector <j> £ 74: Pick <j > o € 
G C (G) with nontrivial projection Pu4> in Pi- Then <j > o is a bounded vector 
by 2.19(b), and Proposition 2.14 implies that (j) = Pn4 > o is bounded as well. 
Pick a nonzero spectral projection Q of the selfadjoint operator U = V£V<p 
corresponding to a subset in R + bounded away from zero. Then U restricted to 
K. := Q(H) is a topological mapping. It follows that as a mapping K. — > V^,(/C) 
the operator V# = Vq ^ is topological. Now Proposition 2.16 (b) ensures the 
existence of an admissible vector ij in /C, and then Proposition 2.40 entails 
that K, is generated by a convolution idempotent. (Note that the last step was 
the only instance where we used that G is unimodular; otherwise we have no 
way of checking if G L 2 (G).) 

Our next aim is to decide for which unimodular groups G the regular 
representation itself allows admissible vectors. Note that in view of Proposition 
2.14, the existence of admissible vectors for Xg provides admissible vectors for 
all subrepresentations as well. Hence for these groups the necessary condition 
7T < Xg is also sufficient, which yields a complete answer at least to the 
existence part of our problem. For unimodular groups, this approach turns 
out to be too bold, except for the somewhat trivial case of discrete groups. 
The following theorem first appeared in [53] , with a somewhat sketchy proof. 

Theorem 2.42. Let G be unimodular. Then Xq has an admissible vector iff 
G is discrete. 

Proof. First, if G is discrete, then the indicator function of {ec}, where ec is 
the neutral element of G, is admissible: The associated wavelet transform is 
the identity operator. Now assume that A g has an admissible vector, then by 
Proposition 2.40 L 2 (G) consists of bounded continuous functions, in particular 
L 2 (G) C L°°(G). In order to show that this implies discreteness of G, we first 
show that for G nondiscrete there exist measurable sets of arbitrarily small, 
positive measure. For suppose otherwise, i.e. , 

e := inf{|H| :4cG Borel , |T| > 0} > 0 . 

Then the infimum is actually attained: For there exists U n such that 

\U n \ < e + 1 /n. Using regularity, we find V n D U n open with \V n \U n \ < 1/n. 
Pick x n € V n , then xf 1 V n is an open neighborhood of unity in G. It follows 
that letting for arbitrary N £ N, 



N 

W N = P| Xf^Vn 

n = 1 

defines a decreasing series of open neighborhoods of unity satisfying 
e< \W N \ < |Uv| < e + 2/iV . 



But then U = fjneN ^ n has measure e. 
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Next pick C C XJ C V, C compact, V open with /x(V \ C) < e. C and 
V exist by regularity of Haar measure. Then V \ C is opi70.3(27t)29D'(2H)5. 3(4-1 .£ 




2.5 Selfadjoint Convolution Idempotents and Support Properties 



43 



connected set, and since Go is noncompact, the closure of 4>{Gq) contains 0. 
On the other hand, </>(e) = |V|, hence </>(G) contains the half-open interval 
]0, |V|]. Hence there exists x € Go such that \V\ — 2e < < \V\ — e, which 

is (2.32). 

Theorem 2.45. Let G be a locally compact group with noncompact connected 
component. Let f £ L 2 (G) and suppose that there exists S £ L 2 (G) such that 
f = f * S and S* € L 2 (G) . If f is supported in a set of finite Haar measure, 
then f = 0. 

In particular, if rj £ Tt n is admissible for the representation it, and V v ip is 
supported in a set of finite Haar measure, for some <p £ then ip = 0. 

Proof. Suppose that / ^ 0 fulfills f = f * S, and in addition C = / -1 (C \ 
{0}) has finite Haar measure. We pick ;ro = e, and apply the last lemma to 
recursively pick X\,X 2 , ■ ■ ■ £ G satisfying 

|C , |-^I<I^CnG fc _ 1 |<|G|-l, k£ N, (2.33) 

where Ck-i = (J^ 1 Xi ^ ^ ■ Then, if we define G^ = (J ieN Gj, we find that 

| Coo | < oo. Indeed, by (2.33), we have 

|C fc+1 | = |Gfe U Xk+iC\ = \C k \ + \x k+1 C\C k \ 

= \Ck\ + |arfc+iG| — |Cfc+i D x k C k \ < \G k \ + > 



which entails the desired finiteness. 

Now define <p = lc^, and consider the operator K : g i— > (p-(g*S). Writing 

I<(g)(x) = <p(x) / g(y)S(y~ 1 x)dy = / g(y)ip(x)S(y~ 1 x)dy 
JG JG 

shows that K is an integral operator with kernel (x,y) e- > p(x)S(y~ 1 x). Since 



[ [ | ip(x)S(y 1 x)\ 2 dydx = yoiC^WS* 
JG JG 



| 2 < OO 



K is a Hilbert-Schmidt operator [101, VI. 23], hence compact. 

On the other hand, ( \c{xk)f)*S = \G{x k )f and supp(AG(a:fc)/) = x k C C 
Gqo show that A c{xk)f is an eigenvector of K for the eigenvalue 1. In addition, 



k - 1 

supp(A G (x fc )/) \ (J supp(A G (x,:)/) 

j=0 



> 0 



by the lower inequality of (2.33), hence the A c{xk)f are linearly independent. 
But this means that the eigenspace of K for the eigenvalue 1 is infinite- 
dimensional, which contradicts the compactness. 
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The condition concerning the connected component is clearly necessary: 
If G is a compact group, the supports of the wavelet transforms are trivially 
of finite measure, yet there are many nontrivial convolution idempotents in 
L 2 (G), arising for instance from irreducible representations. 

Using Theorem 2.45 and Proposition 2.40, we can formulate the following 
sharpening of Theorem 2.42: 

Corollary 2.46. Let G be a locally compact unimodular group with noncom- 
pact connected component. Suppose that 7 i C L 2 (G) is closed and leftinvari- 
ant. If H contains a nonzero function whose support, has finite Haar measure, 
there is no admissible vector for 'LL. 

This concludes the discussion of the relations between continuous wavelet 
transforms and Xq- Let us summarize the main results: 

• A necessary condition for ir to have admissible vectors is that it < Xq- For 
nondiscrete unimodular groups, it is not sufficient. 

• Embedding ir into A a and making suitable identifications, we may assume 
that LL n = L 2 (G) * S, with S a selfadjoint convolution idempotent. 

• Admissible vectors in are those rj for which f >—> f * if defines an 
isometry on LL n . For TL^ = L 2 (G) * S, these vectors are characterized by 
f * ?7 = S. 



Therefore, in order to give a complete classification of representations with 
admissible vectors, we are faced with the following list of tasks: 



T1 Give a concrete description of the closed, leftinvariant subspaces of 
L 2 (G). In terms of the commuting algebra: Characterize the projections 
in VN r (G). 

T2 Given a leftinvariant subspace 74, give admissibility criteria, i.e. cri- 
teria for a right convolution operators g i— > g * f*, with f £ 74, to be 
isometric. 

T3 Characterize the subspaces 74 for which the admissibility conditions can 
be fulfilled. Equivalently, characterize the right convolution idempotents 

S. 

T4 Given a concrete representation n, decide whether n < Xq', if yes, make 
the criteria for T1 - T3 explicit. 



Remark H.fl. Item T4 accounts for the fact that the discussion of the problem 
in L 2 (G), while it makes perfect sense from a representation-theoretic point 
of view, limits the scope of the characterizations for concrete cases, where the 
realization of the representation is usually not given by left action on some 
suitable subspace of L 2 (G). Indeed, in the case of the original wavelets arising 
from the ax + 6-group, the focus of interest is on the action of that group 
on the real line by affine transformations, and the corresponding quasiregu- 
lar representation. First finding an appropriate embedding into L 2 (G) hence 
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turns out to be a serious obstacle which must be overcome before the results 
presented here can be applied. However, for type I groups direct integral de- 
compositions provide a systematic way of translating questions of containment 
of representations to the problem of absolute continuity of measures on the 
dual, and Chapter 5 contains a large class of examples to which this scheme 
is applicable. 



2.6 Discretized Transforms and Sampling 

In this section we want to embed the discretization problem into the L- 
setting, in a way which is complementary to the treatment of continuous 
transforms. In effect, we will only be able to do this in a satisfactory manner 
for unimodular groups. 

Definition 2.48. A family {rj x )xex of vectors in a Hilbert space TL is called 
a frame if the associated coefficient operator is a topological embedding into 
£ 2 (X), i.e., if there exist constants 0 < A < B (called frame constants,) 
such that _ 

A ^ H^ll 2 ^ B \^Alx) I 2 • 

x£X x£X 

A frame is tight if A = B, and normalized tight if A = B = 1. 

In the terminology established in Section 1.1., a normalized tight frame is 
an admissible coherent state system based on a discrete space X with counting 
measure. We next formalize the notion of discretization. 

Definition 2.49. Let n be a representation and 77 G an admissible vector. 
Given a discrete subset r C G, the associated discretization of V rl is the 
coefficient operator V Vi p '■ — 7 £ 2 {r) associated to the coherent state system 

(tt(T)?7 ). 

Remark 2.50. (1) By 2.11 a discretization of V v gives rise to the discrete re- 
construction formula 

/ = — V vf(A) tt(7>7 , 

Cfl 7G.T 

which may be viewed as a Riemann sum version of the continuous reconstruc- 
tion formula (2.10). 

(2) Not all frames of the form Tr(r)p arise as discretizations of continuous 
transforms, i.e., 77 need not be admissible. For instance, there exist frames 
associated to representations which are only square-integrable on a suitable 
quotient of the group [9]; these representations do not even possess admissible 
vectors in the sense discussed here. 

On the other hand, the admissibility of functions giving rise to wavelet 
frames has been established in various settings, e.g., [33, 48, 8], which seems 




46 



2 Wavelet Transforms and Group Representations 



to indicate that under certain topological conditions on the sampling set there 
is a strong connection between discrete and continuous transforms. See also 
Proposition 2.60 for the case that the sampling set is a lattice. 

(3) We deal with discretization in a rather restrictive way, since only isometries 
are admitted. By now there exists extensive literature concerning the construc- 
tion of wavelet frames and related constructions such as Gabor frames, see the 
monograph [28] and the references therein. We have refrained from discussing 
the discretization problem in full depth, since our focus is on Planclrerel theory 
and its possible uses in connection with discretization. 

The same remark applies to the structure of the sampling set: As the 
example of multiresolution ONB’s of L 2 (R) shows, the sampling set need not 
be a subgroup, i.e. it is not required to be regular. However, we will mostly 
concentrate on regular sampling, i.e., the sampling set will be a subgroup. 
It is obvious that the scope of purely group-theoretic techniques for dealing 
with irregular sampling will be limited, although examples like multiresolution 
ONB’s are intriguing. A possible approach to obtain more general group- 
theoretic results, even in the irregular sampling case, could consist in adapting 
the techniques developed in [43] for certain discrete series representations (so- 
called integrable representations ) to a more general setting. 

Clearly discretization is closely connected to sampling the continuous 
transform. Hence the following notion arises quite naturally: 

Definition 2.51. Let G be a locally compact group, T C G. Let TL C L 2 (G) 
be a leftinvariant closed subspace o/L 2 (G) consisting of continuous functions. 
We call TL a sampling space (with respect to r ) if it has the following 
two properties: 

(Si) There exists a constant cu > 0, such that for all f £ TL, 

£|/( 7)| 2 = c w ||/||^ . 

7 er 



In other words, the restriction mapping Rp : TL 9 / i— > (/| r ) g I 2 {T) is a 
scalar multiple of an isometry. 

(S2) There exists S € TL such that every f £ TL has the expansion 

f( x ) = £ /( 7 )S( 7 _1 a;) , (2.34) 

tg r 

with convergence both in L 2 and uniformly. 

The function S from condition (S 2 ) is called sine-type function. Further- 
more, we say that a sampling space has the interpolation property if Rr 
maps onto all of l 2 (T), i.e. any element in £ 2 (T) can be interpolated by a 
function in TL. 
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It will become apparent below that the Heisenberg group allows a variety 
of sampling spaces associated to lattices, but none that has the interpolation 
property. 

The definition is modelled after the following, prominent example: 

Example 2.52 (Whittaker, Shannon, Kotel’nikov). Let G = R, r = Z 

and 

hi = {/ € L 2 (R) : supp(/) C [-0.5, 0.5]} . 

Then 74 is a sampling subspace with the interpolation property, with associ- 
ated sine-type function 



S(x) = sine (a;) 



sin(7rx) 

TTX 



A short proof of this fact, which uses the notions developed here, can be found 
in Remark 2.55 (1) below. 

Our further discussion requires some basic and widely known facts about 
tight frames. 

Proposition 2.53. Let (■ r]i)iei Chi be a tight frame with frame constant c. 

(a) If hi! C hi is a closed suhspace and P : hi — ► hi' is the projection onto hi 1 , 
then ( Prji)i£i is a tight frame of hi' with frame constant c. 

(b) Suppose that c = 1. Then (m)iei is an ONB iff ||? 7 i|| = 1 for all i € I. 

(c) If\\Vi\\ = ||% II- for all i,j G I, then \\ru\\ 2 < c. 

(d) (hi) i(zi is an orthonormal basis iff c = 1 and the coefficient operator is 
onto. 



Proof. Part (a) follows from the fact that on hi' the coefficient operator asso- 
ciated to (Pip)i£i coincides with the coefficient operator associated to 
The “only-if”-part of ( b ) is clear. The “if” -part follows from 

1 = ll%ll 2 = l(%’%>l 2 = 1 + H . % ) 1 2 . 

i£l ij^j 

whence (%,%) vanishes for i j. Part (c) follows from a similar argument. 
The “only if” part of (d) is obvious. For the converse let Si G I 2 (I) be the 
Kronecker-delta at i, and let T : hi — > £ 2 (I) denote the coefficient operator. 
Then ( T*5i,<p ) = (Si, Tip) = ( } for all p £ H implies T*Si = ip, or 
Trji = Si ( T is by assumption unitary), which is the desired orthonormality 
relation. 



The following proposition notes an elementary connection between sam- 
pling and discretization. 

Proposition 2.54. Let rj G hi „ be admissible, and such that n (r)rj a tight 
frame with frame constant c v . Then hi = is a sampling space, and 

S = p-VriV is the associated sine-type function for hi. 
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Proof. Clearly V n (Li 7r ) consists of continuous functions. Using the isometry 
property of V v together with the tight frame property of ir(r)r), we obtain for 
all / = V v (l) e Li 

f=V n <j) = V v i — 

\ Cri 7 er 

= fT V V < l ) ('y) V ri( Al)*!) = /(i)^" 1 -) I 

76 r Cr > 7 er 

with convergence in || • || 2 - Uniform convergence follows from this by Proposi- 
tion 2.39, since = L 2 (G) * V v r]. 

Remark 2.55. (1) The original sampling theorem in 2.52 can be seen to fit into 
this setting. If we pick rj to be the sine- function, we find that V v : Li — > L 2 (R) is 
just the inclusion map, hence 77 is admissible. Moreover, the Fourier transform 
of (Ar {n)r]) neZi yields precisely the Fourier basis of L 2 ([— 1/2, 1/2]). Hence 
Proposition 2.54 applies. 

(2) The proposition shows that various results on the relation between discrete 
wavelet or Weyl-Heisenberg systems and continuous ones give rise to sampling 
theorems: For the wavelet case, the underlying group is the ax + 6 -group. A 
result by Daubechies [33] ensures that every wavelet giving rise to a tight frame 
is in fact an admissible vector (up to normalization), hence we are precisely in 
the setting of the proposition. Similarly for discrete Weyl-Heisenberg system, 
where the underlying group is the reduced Heisenberg group we encountered in 
Example 2.27. Here admissibility of the window function is trivial. Again the 
expansion coefficients are sampled values of the windowed Fourier transform, 
which is the underlying continuous wavelet transform. 

The following theorem serves various purposes. First of all it shows that, 
at least for a unimodular groups, the definition of a sampling space is redun- 
dant: Property (S 2 ) follows from (Si). Moreover it shows that every sampling 
space can be obtained from the construction in Proposition 2.54, hence the 
construction of sampling subspaces and the discretization problem are (in a 
somewhat abstract sense) equivalent. 

Theorem 2.56. Assume that G is unimodular. Let 'LL C L 2 (G) he a leftin- 
variant closed space consisting of continuous functions, and assume that it has 
property (Si). Then Li is a sampling subspace. More precisely, there exists a 
unique selfadjoint. convolution idempotent. S, such that A_S is the associated 
sine-type function, and in addition LI = L 2 (G) * S. In particular, 

Vf&H,V 7 er : /(7 ) = </>Ag(7 )S) , 

and thus Xg(P)S is a tight frame for Li. Li has arbitrary interpolation iff 
A g(r , )-A=S is an ONB of Li. 
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Proof. Define 5 7 = R* r (S 7 ), where S 7 G £ 2 (r) is the Kronecker delta at 7. 
Then —R* r Rp = Id-w shows that 

Crj 1 



/=E/W — , (2-35) 

5tr Cn 

with convergence in the norm. The orthogonal projection P : £ 2 (r) — » R.r(H) 
is given by P = 7^- RrR* r . Moreover, we compute 

m = {Rrf,6J = {f,R? r 6J = {f,SJ . (2.36) 

Next use Zorn’s lemma to pick a maximal family (7-f,:)ie/ of nontrivial 
pairwise orthogonal closed subspaces of the form Hi = L 2 (G) * S',, where the 
S',; are selfadjoint convolution idempotents in L 2 (G). Then Proposition 2.41 
implies that H = @ ieI Hi, this is the only place where we need that G is 
unimodular. Since right convolution with S,; is the orthogonal projection onto 
Hi, equation (2.36) implies for all f G Hi 

</, S 7 * Si) = (f * Si, S 7 ) = (/, Sj) = /( 7 ) = (/, Ag (if) Si) . 

Here the first equality used 2.19(d) and S, = S*, and the second one used 
/ = / * Si- As a consequence, S 7 * Sj = Ac(7)Sj. For all 7 £ r, 

S 7 = E 5 7*^ = E A gC 7)Si , (2.37) 

ie/ ie/ 

with unconditionally converging sums. Since Ag( 7) is unitary, we can thus 
define 

s=e^ 

iei 

and conclude from (2.37) that 



S 7 = A( 7 )S . 

Moreover, S, = S* for all i G I implies S = S*. Finally, for all f £ H, 

(/ * S*)(x) = (/, Xg(x)S) = (/,E Ac(a:)S,:) = ( E / * ^ ) ( x ) = f( x ) ■ 

is/ Vie/ / 

Hence 7Y = L 2 (G) * S, and uniqueness of S was noted in Proposition 2.38. 
Now (2.35) and (2.37) shows that for 7^-S to be the associated sine- type 
function, only the uniform convergence of the sampling expansion remains to 
be shown, which follows from the normconvergence by Proposition 2.39. The 
statement concerning the tight frame property of A g(T)S is now obvious. The 
last statement follows from Proposition 2.53 (d). 
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We next collect some additional observations which concerning regular 
sampling. 

Definition 2.57. A discrete subgroup r < G is called a lattice if the quotient 
G/r carries a finite invariant measure. If a lattice exists, G is unimodular. 
If A C G is any Borel transversal mod r, which exists by 3.f, we let 

covol (r) = \A\ , 

which is independent of the choice of A. 

The well-definedness of covol(.T) is immediate from Weil’s integral formula 
(2.2). The existence of a lattice implies that G is unimodular. 

Proposition 2.58. Let r < G, and suppose that there exists a frame of the 
form 7 r(r)ip, with ip G H n . Then there exist r/ G TL^ such that n(r)rj is a tight 
frame. 

Proof. First note that up to normalization the tight frame property is precisely 
admissibility for the restriction of tt to T. Hence the statement is immediate 
from 2.16 (b). 

Proposition 2.59. Let G be unimodular and r < G a discrete subgroup . 
Assume that TL C L 2 (G) is a sampling subspace for r. Then T is a lattice, 
with covol(r) = A-. 

Proof. If / G TL is any nonzero vector, and A is any measurable transversal, 
we compute 

Iff = [ \f( x f\ 2d TG(x) = f c n \\\ G {x- 1 )f\\ 2 dp. G {x) 

J a J a 

= Wffcn covol(r) . 

The following general observation was pointed out to the author by K. 
Grochenig: 

Proposition 2.60. Let r < G be a lattice and assume that Tr(r)ij is a nor- 
malized tight frame. Then cov ^ r ^ V is admissible, i.e., the frame is a dis- 
cretization of a continuous wavelet transform. 

Proof. For arbitrary <j> G H n and any measurable transversal A mod T 




= »H 2 
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The next proposition gives a representation-theoretic criterion for sampling 
spaces with the interpolation property. 

Proposition 2.61. Let r < G be a lattice. There exists a sampling space 
H C L 2 (G) with interpolation property with respect to T iff there exists a 
representation n of G such that 7r | r — A r- 

Proof. For the “only-if” part pick 7 r = \g\h- For the “if”-part, if T : H — > 
t 2 (r) is a unitary equivalence, then i ) = T~ 1 (Sq) is such that Ti(r)r] is an 
ONB of Tt. Now the previous proposition implies that V rl : Tt n —> L 2 (G) is an 
isometric embedding, and 7 i. = V v (TLff) has the interpolation property. 

At least for unimodular groups, Theorem 2.56 implies that the discretiza- 
tion problem fits quite well into the framework developed for the continuous 
transforms. In particular the construction of sampling spaces and the dis- 
cretization of continuous transforms are equivalent problems. We thus find 
one more task for our list: 



T5 Characterize those convolution idempotents S £ L 2 (G) such that in 
addition A c{r)S is a tight frame of TL = L 2 {G)*S. For the interpolation 
property, decide which of these frames are in fact ONB’s. 



2.7 The Toy Example 

In this section, we solve T1 through T5 for the group G = K. This example 
will provide orientation for the further development, since in this setting the 
solutions turn out to be fairly simple exercises in real Fourier analysis; maybe 
with the exception of T4, which requires more sophisticated arguments. 

As we saw in Section 2.3 , every representation of interest can be realized on 
some translationinvariant subspace on L 2 (R). Moreover, in this setting wavelet 
transforms are convolution operators, hence it is quite natural to expect that 
the convolution theorem plays a role. Usually the convolution theorem is given 
on L 1 , however for our purposes the following L 2 -version will be more useful: 

Theorem 2.62. Let f,g£ L 2 (R). Then f * g* £ L 2 (R) iff fg £ L 2 (]R). In 
that case, (/ * g*) A = fg. 

Proof. The computation 

= (f,\R(x)g) 

= f /H£Me 2 ™ w cfe 

J R 

shows that the convolution theorem boils down to the ’’extended Plancherel 
formula” (2.22) proved in Example 2.28. 
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Solution to T1 

Given a measurable subset Ucl, define 

Hu = {/ G L 2 (R) : supp(/) C U} , 

where as usual inclusion is understood up to sets of measure zero. Then it is 
straightforward to show that Hu is a closed, translationinvariant subspace of 
L 2 (R). The following theorem, which is essentially [104, 9.16], shows that this 
construction of translationinvariant subspaces is exhaustive. 

Theorem 2.63. The mapping 

{U C K. measurable }/ nullsets — * {H C L 2 (G) closed, left-invariant} , 

U ^ Hu 

is a bijection. 



Solution to T2 



Theorem 2.64. Let f G Hu, for 


some measurable U CR. 




f is admissible <£=> 


|/| = 1 a.e. on U , 


(2.38) 


/ is a bounded vector <==> 


/G L°°(t0 , 


(2.39) 


f is cyclic <=> 


/ 0 ( almost everywhere on U) 


. (2.40) 


Proof. Given any / £ L 2 (R), denote by Mj the multiplication operator with /, 



with the natural domain {g £ L 2 (R) : fg € L 2 (R)}. Then the L 2 -convolution 
theorem implies that Vf and Mj are conjugate under the Planclrerel trans- 
form, including the domains. Now the equivalences follow immediately. 

Solution to T3 

Theorem 2.65. Hu C L 2 (R) has admissible vectors iff \U\ < oo. S G L 2 (R) 
is a convolution idempotent iff S = Su '■= 1 u> f or U C R. with \U\ < oo. 

Proof. Any admissible vector / £ Hu has to fulfill |/| = 1 on U, and of 
course / G L 2 ({7). Thus follows the first condition. The characterization of 
convolution idempotents is immediate from the convolution theorem and f* = 

7 - 

Remark 2.66. The arguments for T1 through T3 generalize directly to locally 
compact abelian groups G. Simply replace R by the character group G and 
Lebesgue measure by Haar measure on that group. This applies in particular 
to the cases G = T, Z. 
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Support Properties and the Qualitative Uncertainty Principle 

Combining Theorems 2.65 and 2.45 yields the qualitative uncertainty principle 
over the reals: 

Corollary 2.67. If f G L 2 (R) fulfills |supp(/)| < oo and |supp(/)| < oo, 
then f = 0. 

Proof. |supp(/)| < oo implies f = f * S = V$f for a suitable convolution 
idempotent in L 2 (R). Hence 2.45 applies. 



Solution to T4 



The arguments in this subsection were developed together with Keith Taylor. 
Suppose that (n,Ti n ) is an arbitrary representation of R. A detailed descrip- 
tion of such representation is obtainable by a combination of Stone’s theorem 
and the spectral theorem for (possibly unbounded) operators. More precisely, 
Stone’s theorem [101, VIII. 8] implies the existence of an infinitesimal gener- 
ator, i.e., a densely defined selfadjoint operator A on Jin, such that 

7T (t)=e~ 2vitA . 

In order to understand this formula, we need to recall the spectral theorem 
[101, Chapter VIII]. Let 77 denote the spectral measure of A. Then 77 is 
a map from the Borel cr-algebra of R to the set of orthogonal projections 
on 77 mapping disjoint sets to projections with orthogonal ranges, satisfying 
I7(A fl 77) = 77(A) o 77(7?) as well as 77(R) = Id-^. 77 assigns to each pair 
of vectors x,y £ dom(A) a complex measure n X}V on R by letting n XtV (E) = 
( II(E)x,y ). The spectral measure describes A via 



/*® 

(Ax, y) = / sdll x ,y(s) . 

Jr 

Tlr shorthand for this formula we use 

A = I sdll(s) . 

Jr 

The spectral theorem can be viewed as a diagonalization of the selfadjoint op- 
erator. In particular, exponentiating amounts to exponentiating the diagonal 
elements, hence 



2iritA 



x,y) = 



_ — 27ri st 



dllxjs) 



defines the unitary operator e -27ntj4 . 

We want to decide in terms of the spectral measure whether admissible 
vectors exist. Recall that admissible vectors are in particular cyclic. The fol- 
lowing lemma translates cyclicity into a property of the spectral measure, for 
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which the construction of the representation 7r takes a somewhat more con- 
crete form. The result is well-known, see for instance [95, Chapter I, Proposi- 
tion 7.3]. For the proof of the Lemma we need one more ingredient, namely the 
Fourier- Stieltjes transform on R. For this purpose let M(R) denote the space 
of complex (finite) measures on R. For every p £ M(R), the exponentials are 
absolutely integrable with respect to \fi\, hence the Fourier-Stieltjes-transform 
/x : R — > C of /x, given by 



jS(w) = [ e~ 2wi “ x dp(x) 

J R 

is well-defined. The crucial property of the Fourier-Stieltjes transform is that 
it is injective on M(R) [45, 4.17]. As a consequence, to be used repeatedly in 
the next proof, we conclude for all positive v £ M (R) that the exponentials 
are total in L 2 (R, v): If 0 ^ f £ L 2 (R, v) C L 1 (R, v), then fv £ M(R), and 
thus the Fourier-Stieltjes transform of fv is nonzero. But the Fourier-Stieltjes 
transform of fv is just the family of scalar products of / with the exponentials, 
taken in L 2 (R, v). 

Lemma 2.68. The following are equivalent: 

(i) 7r is cyclic. 

(ii) There exists a positive, finite Borel-measure /x on R and a unitary map 
T : Thr — * L 2 (R, /x) such that, for all B £ Z?(R), we have 

11(B) = T~ 1 P B T , (2.41) 

where P B ■ L 2 (R, /x) — » L 2 (R, /x) denotes multiplication with 1 B , as well 
as 

7T (t) = T~ 1 M t T , (2.42) 

where M t is multiplication with e~ 2mt ' . 



The measure /x is unique up to equivalence. 

Proof, “(x) => (ii)”: Let p be a cyclic vector, and define p = Since /x is 
finite, all the characters e~ 2mt ' are in L 2 (R,/x), and the equality 

(ir(t)p,Tr(s)p) = [ e~ 2 ^ t ~ s)u dll ri}ri = (e~ 2mt ',e~ 2ms ') L 2 ^) 

Jr 

implies that the mapping n(t)p i— > e ^ 27rlt ' may be extended linearly to an 
isometry T : — » L 2 (R, /x); here we used that 7r(R)?7 spans a dense subspace 

of TLt,. It is onto, since T(H n is closed and contains the exponentials, which 
are total in L 2 (R,p). 
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For equation (2.41), we compute 

(Tn(B)n(s)p, e~ 2mt ') = (II(B)ir(s)p,n(t)p) 

= f e-^-^dn^x) 

Jb 

= [ l B (X)e- 2 visX e- itx d^(X) 

Jr 

= (P B T(n(s) V ),e- 2 ^) , 



and thus T 11(B) = P B T : The exponentials are total in L 2 (R, p), and p is 
cyclic. Equation (2.42) is immediate on n(M.)p, and extends to all of H in the 
same way. 

“(ii) => (i)”: The totality of the exponentials in L 2 (R, p) implies that the 
constant function 1 is a cyclic vector with respect to the representation t i— > 
M t . Hence p = T -1 (l) is cyclic for n. 

For the uniqueness result we observe that (2.41) clearly implies n(B) = 0 
iff 77(H) = 0. 



Now we can characterize arbitrary representations with admissible vectors. 
The argument is obtained by sharpening the proof of the lemma. 



Theorem 2.69. n has admissible vectors iff it is cyclic, and in addition the 
real-valued measure fj, associated to its spectral measure by the previous lemma 
is absolutely continuous with respect to Lebesgue measure, with support, in a 
set of finite Lebesgue measure. 



Proof. Suppose that p is an admissible vector for n. The proof consists essen- 
tially in repeating the construction proving the previous lemma and seeing 
that for admissible vectors p the measure p is as desired. For this purpose we 
calculate 

V v m = (<j),Tr(t)p) 

= (<t>,e~ 2 ” itA p) 

= f e^dll^u) , 

J R 



which exhibits V n (f> as the Fourier-Stieltjes transform of the measure 77^. On 
the other hand, V v (j) is an L-function, hence turns out to be absolutely 
continuous with respect to Lebesgue-measure A. We let 

W) = ^ • (2.43) 

This sets up an isometry between H and some subspace of L 2 (R). Let us next 
show that the projection onto T{Tt) is given by restriction to an appropriately 
chosen subset S. For this purpose we compute T rj {II{B)p), for an arbitrary 
measurable subset B. On the one hand, 
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(n(B)rj,rj) = [ dun^B)^ (A) = f dn v ^(X) = [ T(-q)(X)dX . 

Jr Jb Jb 

On the other hand, the isometry property of T ^ gives that 

(n(B)r,,r,) = {T^nWn), T v ( V )) = [ T r ,(n(B))(X)T r ,(rj)(X)dX 

Jr 

= [ T^)(X)T v ( v )(X)dX . 

Jb 

Since this holds for all subsets B , we obtain that T v (rj)(X) = T ri (r])(X)T v (r])(X) 
a.e., which entails T^(r/)(A) € {0,1}. On the other hand, T n {rj) is square- 
integrable, hence it is the characteristic function of a set E of finite Lebesgue 
measure. To show that T V (H) = L 2 (E,dx), we note that T v {II{B)ij) = 1 b, 
and the characteristic functions span a dense subspace of L 2 . 

Replacing n(B)r] by /. i(B)cj) in the above argument gives T ri (n(B)<f > ) = 
1 bT^^)- Similarly we obtain T v (Tr(t)(j)) = e~ 2mt ' T v {4>) , and we have shown 
the “only-if” -direction. 

For the other direction, we construct an admissible vector for the equiv- 
alent representation acting on L 2 (A7), by picking 77 = 1^. Then for every 
^L^JcL 1 ^) 

Vr,(j){t) = J e 2mtX (j){X)dX = 4>(-t) , 

which immediately implies HI/^Hl 2 = ||</>||. 

Remark 2. 70. Given a representation 7 r with admissible vector, we have now 
found two different ways to arrive at an equivalent representation if}/ acting 
on L 2 (U, dx) C L 2 (R) for some measurable U C R. by 

(if (t)/)H=e- 2 ^/M . 

The first one consists in embedding TL n in L 2 (G) via V n , and then applying 
Theorem 2.63 to see that 7 r ~ nu for a suitable U . 

A shortcut is described by the mapping T v constructed in the proof of 
2.69. In fact, it is not hard to see that we have the following commutative 
diagram 

Vv 

H* —7 Hu 

Tr, \ IB 

L 2 (U, dx) 

Indeed, observing that T v (ip) e L 2 (A7) C L 1 (A7), we can apply the Fourier 
inversion formula to (2.43), obtaining 

T(^) v (s)= f e 2vist T(ip){t)dt = f e 2 ™ t dIl v , ri (t) = (<p,e- 2 ™ A V ) 

Jr Jr 

= VvV(s) ■ 
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Note also that the admissibility condition obtained in 2.64 coincides with 
the admissibility condition which is derived in the proof of Theorem 2.69. 
This is owed to the fact that both are just the admissibility conditions for 
the representation iff, translated to the respective settings by the associated 
intertwining operators. 



Solution to T5 



Here we focus on regular sampling, i.e. , T = aZ is assumed to be a lattice, 
with a > 0. The following theorem can be seen as a refinement of Shannon’s 
sampling theorem. It can be regarded as folklore. Similar results for arbitrary 
locally compact groups were obtained for instance by Kluvanek [76]. 

Theorem 2.71. Let Ttu with associated idempotent S = 1^-. The following 
are equivalent: 

(a) Ar (T)S is a tight frame, i.e., Hu is a sampling space. The constant cu 
associated to Hu is 1/a. 

(a’) There exists f € Hu such that Ar (T)f is a frame. 

(a”) There exists f £ Hu such that Ar (T)/ is total. 

(b) \U H i/r - I' - 0, for all 0 7 k € Z 

Regarding the interpolation property, we have the following equivalent condi- 
tions: 

(i) Hu is a sampling space with interpolation property. 

(ii) \U D ^ + U\ = 0, for all 0 7 k £ Z, and \U\ = 

Proof, (a) (a’) => (a”) is obvious. Now assume that (a”) holds. If Ar (T)f 

is total in Hu then / is a cyclic vector for the translation action of Ar on Hu- 
Hence / yf 0 almost everywhere on U, by condition (2.40). Suppose that (b) is 
violated, i.e., there exists A C U measurable with |H| > 0 and — + A C U , for 
a suitable nonzero k. Possibly after passing to a smaller set A we may assume 
that | f(u) + afc)| > e for some fixed e > 0 and all to € A. Then letting 






1 for w G 4 

_ /(u,-fc/a) for k +A 

/M « 



defines an L 2 -function supported on A U ^ + A satisfying 

= -/(w + -)g(uj + -) 
a a 

on A. Given £ E Z, the 1 /a-periodicity of exp(27ria£*) then implies that 
( 5 ,A R K)/) = <5,e- 2W 7)=0 • 



Hence Ar(q;Z)/ is not complete, which gives the desired contradiction. 
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Now assume (b). Pick a Borel set V D U fulfilling (b) and such that in 
addition, \B\ = 1/a. In other words, V is a measurable transversal containing 
U. Then the 1/a-periodicity of the exponentials and the fact that the expo- 
nentials (suitably normalized) form an ONB of L 2 ([0, 1/a]) implies that they 
also form an ONB of L 2 (P). Then the restriction of the exponentials to U are 
the image of an ONB under a projection operator, i.e., still a normalized tight 
frame with frame constant 1/a, by 2.53(a). Pulling this back to Hu gives the 
desired statement. Moreover, we have also shown (ii) => (i). 

For (i) =>• (ii) we note that the first condition in (ii) follows by (a) =>• (b), 
whereas the second one follows from the requirement that a 1 / 2 ||Sj |2 = 1. 

We close the section with the observation that not every continuous trans- 
form can be regularly sampled to give a discrete transform. 

Example 2.72. There exists a space Hu which has admissible vectors but does 
not admit frames of the form Am(aZ)/. For this purpose, pick U C R. open, 
dense and of finite measure, say a union of suitably small open balls around 
the rationals. Then there exist admissible vectors by Theorem 2.63, but since 
for t € R. arbitrary UC\t + U is open and nonempty, condition (5) of Theorem 
2.71 is always violated. 

Question: Does there exist a discrete set r C R. and ?y £ Hu such that 
Ar(.T )?7 is a frame? 
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The Plancherel Transform 
for Locally Compact Groups 



This chapter provides, for general locally compact groups, the Fourier side that 
has proved so useful for the treatment of the toy example. We start out by 
taking a second look at the toy example, this time with a more representation- 
theoretic slant. 



3.1 A Direct Integral View of the Toy Example 

This section contains a first, nonrigorous introduction to direct integrals. The 
purpose is twofold: We use the arguments given in Section 2.7 as an illustration 
of the direct integral view, and thus obtain an overview of the results needed 
to extend the reasoning to other groups. 

Abstract harmonic analysis as used in this book can be described as the 
endeavor to completely understand the representation theory of a given group 
in terms of its irreducible representations. The idea behind this approach is 
that irreducible representations should serve as building blocks, and that a 
technique of uniquely decomposing arbitrary into those building blocks would 
allow to compare different representations, to characterize intertwining oper- 
ators etc. 

For illustration purposes let us first consider a finite group G. Then any 
given representation n of G can be decomposed into a direct sum of irre- 
ducibles, 

7r -® cr * • (3.1) 

iei 

If we define the associated multiplicity function on G by 

m n (a) = \{i€ I : a, ~ cr}| 

as in Remark 2.32, we can rewrite the decomposition as 

7T ~ ® m OT (cr) • a . (3.2) 

creG 



H. Fiihr: LNM 1863, pp. 59-103, 2005. 
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One of the advantages of (3.2) over (3.1) is that the invariant subspaces cor- 
responding to ?n w (cr) • a in (3.2) are unique, by contrast to the subspaces 
carrying the irreducible subrepresentations <r,: in (3.1). Now the significance 
of (3.2) is that, given a second representation tv with associated multiplicity 
function m ^ it can be shown that 

ir < n £ G : m n (a) < m^(c r) . (3.3) 

In other words, we are able to break the problem of deciding equivalence or 
containment of arbitrary representations down into classifying and counting 
the irreducible components. 

Thus the basic task in representation theory can be stated in form of the 
following two questions: 

1. Which subrepresentations occur? 

2. For those irreducible that do occur, what is their multiplicity ? 

While the multiplicity function contains the answers to both questions, the 
advantage of this formulation is that it generalizes to more general, in par- 
ticular noncompact, groups. This will become clear if we switch attention to 
the case G = R. The first thing to realize is that direct sums of irreducible 
representations no longer suffice to describe all representations of R. The sim- 
plest example is Ar: We have already observed before, in Theorem 2.35, that 
noncompact abelian groups do not have a discrete series. Therefore Ar cannot 
have irreducible subrepresentations; though in a sense made more transparent 
below they occur infinitesimally in the decomposition. 

The correct generalization of the decomposition theory of finite groups, 
which includes the real case, thus turns out to be provided by direct inte- 
grals, which we sketch next. Suppose we are given a family (or bundle) of 
(separable) Hilbert space (W w ) we K . On each 7i u , we let R act unitarily by the 
character 7r w given by 

■K u (s)r] = e~ 2n ' ws r) . 

Hence, tt u ~ m, r (w) • Xw, where ?n^(w) = dim (W u ). We define vector fields 
as cross-sections to the bundle, i.e. mappings / : satisfying 

f(u>) € Huj. The idea is to let the group act on vector fields / by acting on each 
fibre f(u>) by the corresponding representation The means of synthesizing 
the different representation spaces into one Hilbert space is now obtained by 
introducing a positive measure v v on R, defining the direct integral space 

/*© 

Hit = / H u dv n (uj) 

Jr 

as the set of all vector fields satisfying 

II / II 2 := [ \\f(u)fdv v {u) < oo . 

Jr 
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All measure-theoretic detail necessary to make the construction rigorous will 
be given in the following sections. The only purpose of this section is to provide 
motivation, and we use direct integrals in a purely formal fashion. The scalar 
product of two elements f,g& 'H.-k is given by 

( f,9)= [ (/M,5(w)) w dv n (uj) . 

Jr 

The representation n = J R n u) di' n (u)) acts on TL-n by 

(tt(<)/) (w) = n u (t)f(u) = e~ 2mut f (u>) . 

Since each 7r w is unitary, it is intuitively clear that 7r is unitary. The measure 
v prescribes which irreducible representations occur (and how), whereas m „ 
prescribes the multiplicities. Now the central statements of direct integral 
theory for R (extending to groups of type I) are: 

1. Every representation is unitarily equivalent to a direct integral represen- 
tation, and the associated pair (i/„, m n ) is unique up to measure-theoretic 
technicalities: v is unique up to equivalence, and m, is unique up to v^- 
nullsets. 

2. 7r < fr iff is ^-absolutely continuous, and to n < m^, ^-almost every- 
where. 

Let us now reexamine the Fourier arguments used in Section 2.7 in terms 
of direct integrals. 

Containment in the Regular Representation 

Straightforward calculation yields that the Plancherel transform on R has the 
following intertwining property: 

(A R (:r)/) A M = Xo (3-4) 

We consider / as a vector field (/(w)) w6 r, where each f(u>) = = C. Then 

the square-integrability property of / yields 

/ € [ 'H U jdio . 

Jt 

Hence the Plancherel formula yields that the Fourier transform is a unitary 
equivalence intertwining the regular representation of R with a direct integral 
representation tt, where is Lebesgue measure and the multiplicity function 

^7T = 1 • 

We first apply this observation to Theorem 2.69. If 7 r is an arbitrary rep- 
resentation of R, we can write 
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/•© 

/ m n (uj) • Xa, dv n (w) . 

Jr 



Direct integrals provide a refinement of the argument in the proof of Theorem 
2.69 using the spectral theorem: For a Borel set B C R let 11(B) be the 
projection operator on H^ given by 

11(B) f(w) = l B (w)f(u) . 

Then we can, at least formally, define an operator A via the relations 



(Ax, y) = / ujdn XtV (ui) 

Jr 



with n X}V (B) = ( II(B)x,y ). This definition entails n (t) = e ~ 2nltA . Hence we 
have retrieved from the direct integral all the data used in the proof of 2.69. 
Lemma 2.68 can now be understood as a characterization of cyclic represen- 
tations in terms of the multiplicity function: A representation of R is cyclic iff 
in „ = 1, at least ^v-almost everywhere. Moreover 2.69 becomes an instance 
of the general procedure for checking containment: After we have established 
that the measure underlying the decomposition of Ar is Lebesgue measure, 
with multiplicity function = 1 , every subrepresentation necessarily arises from 
a Lebesgue-absolutely continuous measure, with multiplicity < 1. 

A second instance of this argument applies to Theorem 2.71. Let us con- 
sider a representation 7 tjj of R acting on a space ‘Hu, and its restriction to 
r = olL. We are looking for tight frames of the form Tr(r)i ], i.e. admissible 
vectors 77 G Hu for the restriction nu\r- 

First we apply similar reasoning to Z instead of R to obtain that the 
Fourier transform on £ 2 (Z) yields a decomposition 



Xu> dm 



where X^(n) = e 2mnuj denotes obviously an element of Z. Hence the decom- 
position of Az is based on Lebesgue measure on the interval, and multiplicity 
= 1 . 

Next consider the representation 7To of Z defined by 7To(fc) = iru(cxk). 
Again we need to compute a decomposition into a direct integral of irreducible 
representations over Z. For this purpose we start out by writing 



£ 2 (Z )dw . 



This can be seen by mentally rearranging functions / G L 2 ( 
sequences ((F u (k)) ke z) w 6 [ 0 ) i/ a] , where 



as families of 



F u (k) = /(<u + k/a) . 
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The map / — > F then implements (3.6). Now let I u = {k £ Z : uj + k/a £ U}, 
and 

m no (w) = ^ 1 u{u + k/a) = dim(f 2 (/ w )) . 
fee z 

From the definition of I u we obtain immediately that the restriction of the 
operator yielding (3.6) to L 2 {U) provides 



L 2 (U) 



'[0,1 /c 



(. 2 {Iu)dio 



(3.7) 



Finally, the fact that the restrictions of and x^+t to r are equivalent iff 
t is an integer multiple of 1/a yields that (3.7) effects a decomposition into 
irreducible representations, 



/*® 

tto — / rn no (u) ■ Xu><ko (3.8) 

J [0,1/a] 

Now checking no < Az amounts to comparing (3.5) with (3.8), yielding 
the necessary condition 

m no (uj) <1 , for almost every oj £[ 0, l/a[ , 

which is condition ( b ) from Theorem 2.71. It is also sufficient: Since Z is 
discrete, Az has an admissible vector, and thus every subrepresentation does, 
by 2.14. 

Invariant Subspaces and the Decomposition of the Commuting 
Algebra 

The characterization of invariant subspaces given in Theorem 2.63 also has 
a representation-theoretic background. Since invariant subspaces correspond 
to projection in 7r(G)', it is natural to extend the decomposition theory to 
commuting algebras. For this purpose let us take a look at direct sum decom- 
positions, i.e. consider again 

* = © ,T * 

i£l 

with irreducible <r,; . Write an operator T in the commuting algebra as a block 
matrix operator ( , where T t j : Ti r!i — > 'H rTj is the restriction of Pj o T 
to Hi, with Pj denoting the projection onto H aj ■ Clearly T/j is an intertwining 
operator, therefore T/j = 0 whenever cr, aj, by Schur’s lemma. Hence, 
rewriting again the decomposition of 7r as 

(J) m w (cr) • a 
aeG 



7 r = 



(3.9) 
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we observe that every intertwining operator T has block diagonal structure 
( T a ) g, where each T a intertwines ?Ti 7 r (cr) • a with itself. (As a matter of fact, 
it is this property of the decomposition (3.9) that guarantees the contain- 
ment criterion (3.3).) Now the correct generalization of the decomposition of 
intertwining operators to the case G = K. is 

3. If 7 r = /pi m n (u>) - Xu dv^iu) is a direct integral of irreducibles, then every 
intertwining operator T of 7r has the form 

(Tf)(u) = T u f(u) , 

where T u : 'H ul — > are suitably chosen operators. Here denotes the 

representation space of m v (u>) ■ 

An application of this fact to the decomposition of the regular represen- 
tation yields that every operator commuting with the regular representation 
decomposes on the Fourier side into operators T u : C — > C, i.e., functions. 
Since operator multiplication translates to pointwise multiplication, and tak- 
ing adjoints to complex conjugation, we find in particular that projections 
correspond to functions with values in {0,1}. Hence the projection onto an 
invariant subspace is given by multiplication with the characteristic function 
of a suitable Borel set, which is precisely the statement of Theorem 2.63. 



Wavelet Transform, Admissible Vectors and Plancherel Inversion 

Finally let us take a closer look at the admissibility conditions. For U C R. of 
finite measure, let f fu denote the representation acting on L 2 (U) via 

(7r(x)F)(v)=e- 2 ™*F(to) , 



then obviously 



7TU 




Xudio 



and the representation is conjugate under the Plancherel transform to the 
restriction of Ar to Hu- Now, picking 77 € L 2 ((7) we obtain 



V n F{x) = [ F(u) V (uj)e 2 ™ x dx , 

Ju 

hence V v is pointwise multiplication with 77 , followed by Plancherel inversion. 
Since the latter is unitary, V v is an isometry iff ( 77 ! = 1^; and similar properties 
of 77 such as cyclicity, boundedness etc. are just as easily read off. 
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Summary 

Our discussion of the toy example used the following representation-theoretic 
facts: 

1. Representations of R. (and Z) can be decomposed uniquely into irre- 
ducibles; containment of representations can be checked by comparing 
measures and multiplicities. 

2. The commuting algebras of the representations are decomposed as well. 

3. The Plancherel transform on L 2 (R) yields the decomposition of Ar into ir- 
reducible representations. Given a realization of the representation on the 
Plancherel transform side, admissibility conditions and wavelet transforms 
are closely related to pointwise Plancherel inversion. 

For the remainder of this chapter we will be concerned with deriving and 
constructing the analogous results and objects for general type I groups. The 
chief object of interest will be the Plancherel transform. The aim is to con- 
struct a unitary operator 

V : L 2 (G) - ^ B 2 (H a ) dv G (a) , (3.10) 

Jg 

having properties analogous to 1. through 3. from above. The following sec- 
tions are dedicated to elucidating the various objects occurring on the right 
hand side, and the necessary assumptions to guarantee their existence: Section 
3.2 contains the basic notions concerning Borel spaces. In particular, regular- 
ity properties of such spaces are crucial to make direct integral theory work. 
We discuss direct integrals, their construction, as well as existence and unique- 
ness of the decomposition of unitary representations into irreducible represen- 
tations, in Section 3.3. Section 3.5 then presents the Plancherel theorem for 
unimodular groups. Nonunimodular groups require a different treatment; the 
construction needs to be modified by use of a family of unbounded operators, 
the Duflo-Moore-operators. These operators are intimately related to ad- 
missibility conditions, thus a detailed study is indispensable. This requires an 
excursion into Mackey’s theory (Section 3.6), as well as a section containing 
somewhat technical results concerning operator-valued integral kernels (Sec- 
tion 3.7). Section 3.8 finally presents the Plancherel formula for nonunimodu- 
lar groups. We include a proof of the isometry part of the Plancherel formula 
which illustrates the role of Mackey’s theory in establishing the Plancherel 
formula for the group. 

The definitions and results presented in the course of this chapter are not 
intended as a self-contained introduction to direct integral decompositions 
and the Plancherel transform, but rather as a guided tour of key results. For a 
more complete exposition we refer the reader to the monographs [35, 45, 82]. 
However, we intend to give sufficient details and references to guarantee a 
rigourous use of the results in the following chapters. 
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3.2 Regularity Properties of Borel Spaces* 

Regularity of Borel spaces is an important issue in direct integral theory. Here 
the central notion is that of a standard Borel space: 

Definition 3.1. A Borel space X is called 

1. countably separated if there exists a countable family (A n ) ne j,j of mea- 
surable sets such that for all x £ X : {x} = |J{A„ ; x £ A n }. 

2. standard if there exists a Borel isomorphism X — > Y, where Y is a com- 
plete separable metric space, endowed with the Borel cr-algebra generated 
by the topology. 

3. analytic if it is countably separated, and in addition there exists a sur- 
jective Borel map Y — » X , where Y is a standard Borel space. 

That standardness is a rather strong property of Borel spaces can be read 
off a famous classification result due to Kuratowski: Every standard Borel 
space is Borel isomorphic either to a countable (discrete) space or to [0, 1] 
endowed with the usual structure [94, Theorem 2.14]. Furthermore we obtain 
the following useful result [94, Theorem 2.13]. 

Theorem 3.2. Let (f> : X — ► Y be an injective measurable mapping, where X 
is standard and Y is analytic. Then <j>{X) is a Borel subset ofY. In particular, 
if Y is standard as well and </> is bijective, it is a Borel isomorphism. 

As an immediate consequence we see that a subset of a standard Borel 
space is standard itself iff it is Borel in the larger space. 

We will say that a measure // is countably separated (or standard) 

if there exists a measurable subset X' C X with n(X \ X') = 0 which is 
countably separated (standard). 

An interesting and important question is the behavior of Borel structures 
when passing to quotients. If TZ C X x X is an equivalence relation, the 
quotient Borel structure on the quotient space X/1Z is the finest cr-algebra 
making the projection map X — > X/1Z measurable. Hence a subset of X/1Z is 
in the quotient cr-algebra iff its preimage under the projection map is in the 
cr-algebra on X . The key problem here, which is closely related to the type I 
condition discussed in more detail below, is the fact that X/1Z need not be 
standard even when X is. 

Given a locally compact group G and H < G, G/ H become Borel spaces in 
the usual way by taking the cr-algebra generated by the open sets. If the group 
is second countable, it is in fact completely metrizable and thus standard; the 
same holds for the quotients. As a consequence of these facts and Theorem 3.2 
we note that under mild conditions on the given group action, quotients and 
orbits can be identified measure-theoretically. This fact will be used repeatedly 
throughout the text to identify quotients and orbit in a measure-theoretic 



sense. 
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Proposition 3.3. Let X be an analytic Borel G-space. Then for all x € X 
the canonical map G 9 g i— > g.x induces a Borel isomorphism between G/G x 
and G.x. Hence the latter is a Borel subset of X. 

We will sometimes need measurable cross-sections and transversals. De- 
noting by qh : G — > G/H the quotient map, a cross-section a : G/H — > G 
is a right inverse to q , i.e., a map fulfilling a(xH)H = xH , for all x G G. A 
transversal (mod H) is a set A C G meeting each right coset xH in precisely 
one point. There is a natural bijection between cross-sections and transver- 
sals: Every transversal A induces a cross-section a by letting a(xH) = y G A 
with yH = xH. Conversely, a(G/H) C G is clearly a transversal, if a is a 
cross-section. The close connection extends to measurability properties: The 
cross-section is a Borel map iff the associated transversal is a Borel set; this 
is seen by applying 3.2 to the cross-section. We have the following existence 
result: 

Lemma 3.4. Let G be second countable and H < G closed. Then there exists 
measurable cross-sections and transversals of G/H. 

Proof. See e.g. [86, Lemma 1.1]. 



3.3 Direct Integrals 

In this section we discuss the construction of direct integrals of Hilbert spaces 
and von Neumann algebras. 

3.3.1 Direct Integrals of Hilbert Spaces 

We use the definition of direct integrals in [45]. Given a family {fH x ) x ex of 
separable Hilbert spaces, the fibre spaces indexed by elements of a Borel 
space X, a vector field is cross-section, i.e. a mapping rj : X — > 
satisfying r](x) G H x for all x G X. Direct integral spaces are spaces of vector 
fields which are square-integrable. Thus we need to have a notion of mea- 
surability. Not surprisingly, measurable vector fields are defined in terms of 
coordinates with respect to certain bases (or at least total systems) of the fibre 
spaces. More precisely, a measurable structure on (H x ) x ^x is a family of 
vector fields (e™) x6 x (n G N) having the properties 

• For all m, n, the mapping x e- > (e™, e") is Borel. 

• For all x G X, the family (e")„ 6 N is total in Tt x . 

If a measurable structure exists, (' H x ) x ^x is a measurable field of Hilbert 
spaces. Vector fields (rj x ) x ^x are defined to be measurable if all map- 
pings x i— > {r] x ,e™) are Borel. The following Proposition [45, Proposition 
7.27], shows that if measurable structures exist, they can come in the form 
of measurable fields of ONB’s. The following proposition rests among other 
things on the observation that Gram-Schmidt orthonormalization does not 
affect measurability. 
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Proposition 3.5. Let (LL x ) xe x be a measurable field of Hilbert spaces. Then 
the mapping d : x i— > dim(7i x ) is a measurable mapping. Moreover, there 
exists an equivalent measurable family of ONB’s, i.e., a family (e x ) x& x 
such that for all x £ X, the vectors (e") n= i i ... ( j( a ;) are an ONB of Tt x , and in 
addition, ((e”)^ ;t)neN has the same measurable vector fields as the original 
measurable structure. 

Given a measure v on X , a ^-measurable field of Hilbert spaces is a field 
of Hilbert spaces with the property that there exists a //-nullset Y such that 
(Wx)xe x\y is a measurable field of Hilbert spaces based on X\Y. 

Now, given a Borel measure v and a ^-measurable field (LL x ) xe x of Hilbert 
space, the direct integral space Li = j^LL x dv{X) is given as the space of 
measurable vector fields (rj x ) X QX satisfying 



\r) x \\ 2 du(x) < oo 



/x 



where, as usual, ^-almost everywhere agreeing fields are identified. LL is a 
Hilbert space with scalar product 



{(Vx)xex,(Vx)xex) = / {Vx,Tx)dn(x) . 

J x 

While the space of measurable vector fields depends on the particular mea- 
surable structure, the direct integral space is, up to a canonical unitary equiv- 
alence, unique. Also, changes on a z'-nullset clearly do not affect the construc- 
tion. 

A particular case of direct integrals, also arising in the context of induced 
representations, is of a constant field of Hilbert spaces, i.e. we consider 




LL x dv{x) , LL X = LL . 



Clearly the simplest realization of this is obtained by taking a fixed ONB of 
LL to induce a measurable structure. Thus we see that 




LL x dv(x) 



L 2 (X,m,H) , 



the space of all measurable, square-integrable vector fields on X with values in 
Li. Here LL is endowed with the Borel structure induced by the weak topology, 
which for separable Hilbert spaces coincides with the Borel structure induced 
by the norm topology. For later use we note the following result which shows 
that L 2 (X, v\ LL) is closely related to the tensor product L 2 (A, v) (g) Li. 

Lemma 3.6. If (f f jej is an ONB of L 2 (X,is) and (e,:), e / an ONB of LL. 
then constitutes an ONB of L 2 (X , n; LL) 




3.3 Direct Integrals 



69 



Proof. It is clear that the system is an ONS. Hence it remains to show that 
it is total. For this purpose let F G L 2 (X, H) be nonzero. Since 

ll F 0)H 2 = \( F ( X )’ e i)\ 2 

iei 

does not vanish identically, it follows that at least one of the functions 

fi{x ) = (. F(x),ei ) 

is nonzero. Then the completeness of the (j> 3 implies that at least for one j € J 

O7 A {fi,<t>j) = {<t>jei,F) . 

For use with the Plancherel formula, we will also need direct integrals 
of operator spaces. Given a measurable field ( H x )xex of Hilbert spaces, the 
direct integral space 

/*® 

/ B 2 {H x )dv{x) 

J x 

can be conveniently constructed from the direct integral of the 7 H. x . E.g., a 
measurable structure for f x H x dx yields a measurable structure 

(e" <g) e™) mi „ e / x for /® B 2 {fH x )dx. Using (1.5), any field T of Hilbert-Sclrmidt 
operators can be written as 




where the (e”) ne / x are the ONB of H x provided by the measurable structure, 
and it is immediate to check that T is measurable iff (</?”) n eN is a measurable 
vector field, for each n € N. These criteria may be applied to check the 
following result which will be used below. 

Lemma 3.7. Let a measurable field ('H x ) x ex of Hilbert spaces be given, and 
let (A x ) xe x be a measurable field of Hilbert- Schmidt operators. Let A x = 
be the polar decomposition of A x . Then {U x ) x ^x and ( \A x \) xe x ore 
measurable as well. 



3.3.2 Direct Integrals of von Neumann Algebras 

Measurable operator fields are families of (not necessarily bounded) oper- 
ators T x : TL X TL X such that x 1 — > (r/ x , T x ip x ) is measurable for all measurable 
vector fields i),tp with ip x G dom(T a; ). For a given measure u, ^-measurable 
operator fields are defined in the obvious sense. In order to check measurabil- 
ity, it is sufficient to plug in elements of the measurable structure for 77 , and 
for (p if a measurable structure with elements in dom(T x ) exists. 




70 3 The Plancherel Transform for Locally Compact Groups 

Given a measurable field of bounded operators T x such that the operator 
norms are essentially bounded, then 

(/v Txdu ( X ^) ^ = 

defines a bounded operator j®T x dv(x) on f® Ti x dv(x). Operators of this 
type are called decomposable; if almost all T x are scalar, the operator is 
called diagonalizable. 

In connection with commuting algebras, the decomposition of von Neu- 
mann algebras into direct integrals will be crucial. In the following let 

7 1 = fx 'H x dv{x) and a family of von Neumann algebras (A x ) x ex with 
A x C B(H X ) be given. As might be expected, there is a measure-theoretic 
condition involved [36, II. 3. 2 Definition 1]: 

Definition 3.8. (A x )xex is measurable if there exists a countable family of 
measurable operator fields ((T") xe x)„ e ^ such that, for v-almost every x £ X , 
(3T) generates A x . 

Obvious examples of measurable fields of von Neumann algebras are A x = 
B(H X ), or A x = C • ld Hx . 

A direct integral of a measurable field of von Neumann algebras (A x ) x ^x 
is constructed in the expected manner, i.e. , 

/*® 

/ A x dv{x) 

J x 

consists of all ^-measurable operator fields ( T x ) xe x , essentially bounded in the 
operator norm, such that T x £ A x (n-a.e.). Conversely, given a von Neumann 
algebra 

/•® 

A C B( / H x dn(x)) , 

J x 

we say that A decomposes if 



/*® 

A = A x di , (x) 

J x 

for some measurable field of von Neumann algebras. Obviously the algebras of 
decomposable resp. diagonalizable operators are decomposable von Neumann 
algebras. In fact, it is obvious from the definition that these are the largest 
resp. smallest decomposable von Neumann algebras. Note that not every von 
Neumann algebra consisting of decomposable operators is decomposable; the 
former condition only means that A C ff- B(fH x )dn{x). 

In all cases of interest for us, taking commutants behaves in the expected 
way ([36, II. 3. 3 Theorem 4]) 
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Theorem 3.9. Suppose that X is standard. If 



then 



/*® 

A = / A x dv(x) 

J x 



/*® 

A! = / A! x dv{x) . 

Jx 



3.4 Direct Integral Decomposition 

Now let Tt = fy Ti x d,v(x). For a group G, let a family (a x ) xe x of unitary 
representations, with a x acting on Tt x , be given. The family is called mea- 
surable field of representations if for all g £ G, (a x (g)) x& x is measurable. 

The direct integral representation 




a x dv{x) 



G 9 ) 




a x (g)du(x) 



is a unitary representation of G, which is again well-defined and unique up to 
unitary equivalence. 

Recall that our principal aim is direct integral decomposition, meaning 
that we are looking for ways of establishing a unitary equivalence between a 
given representation and a direct integral, hopefully with useful uniqueness 
properties. Also, we would like to be able to use the dual G as base space X. 
As will be seen below, the general case requires that we need to put up with 
a usually larger (and less transparent) carrier space for direct integrals, the 
quasi-dual G. 

Our main source for this section is [35] . Results given there for G*-algebras 
are cited here for the group case, without further comment. The justification 
for this is given by [35, 13.3.5,13.9]. One further piece of vocabulary that is 
useful for checking the citations from [35] is the word ” postliminal” which 
keeps reappearing in [35]. Recall that we always assume the underlying group 
to be second countable. Here ’’postliminal” is synonymous to ’’type I” [35, 
13.9.4], and the latter will be defined in the next subsection. 



3.4.1 The Dual and Quasi-Dual of a Locally Compact Group* 

Definition 3.10. Let G be a locally compact group. A factor representa- 
tion of G is a representation n fidfilling n(G)' O 7 r(G)" = C • Id-^ . 

The suitable equivalence relation between factor representations is quasi- 
equivalence, as can be seen by the following statement [35, Corollary 5.3.6]. 

Proposition 3.11. Let n,a be factor representations. Then either 7 t ~ a or 
7 r and a are disjoint. 
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The equivalence classes of factor representations modulo ss yield the quasi- 
dual G of G. Clearly, irreducible representations are factor representations. 
The following proposition notes that there is in fact a canonical embedding 
G c -> G. The first statement follows from [35, 5.3.4], the second statement is 
[35, 5.3.3] 

Proposition 3.12. Let ir = m - <t with a £ G. Then n is a factor representa- 
tion. Moreover, it « n ■ a' , for a' £ G, iff a ~ a' . 

Factor representations corresponding to elements of G are also called factors 
of type I. In view of this terminology (which originates from the theory of 
von Neumann algebras), the following definition is natural. However, the full 
scope of this notion will only become clear later on. 

Definition 3.13. G is called type I if G = G. 

Remark 3.1 f. Since the type I property of the underlying group will be a 
standing assumption below, a few remarks regarding the type I condition are 
in order. 

The class of type I groups contains the abelian and the compact groups. 
In the connected Lie group case, the exponential solvable (in particular the 
nilpotent) groups, confer [23, Chap. VI, 2.11], as well as the semisimple ones 
[63], are known to be type I. Other groups obtained from these classes via 
group extensions can be dealt with using the Mackey machine; see in partic- 
ular Theorem 3.39(c). This result allows to check for instance that many of 
the semidirect product groups arising in mathematical physics, such as the 
Poincare and Euclidean motion groups, are type I. 

By contrast, a discrete group G is of type I only occurs if it contains a 
normal abelian subgroup of finite index [111]. Thus the following hardly ever 
applies to discrete groups, with the lucky exception of the group considered 
in Section 5.5. 

For integration on G and G we need Borel structures on these spaces. For 
this purpose let us fix Hilbert spaces Tt n ( n € N U {oo}) of Hilbert space 
dimensions n. Now let 

Rep n (G) = {7T : 7T representation of G on TL n } 
and endow it with the smallest u-algebra for which all the coefficient maps 

7 T e->. < 77 , n(x)0 , 

with ieG, )),(£ TL n , are measurable. Moreover, let 

Rep(G ) = (J Rep n 

n£NU{oo} 



and endow it with the direct sum structure 
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A c Rep(G) measurable <t=> Vn £ N U { 00 } : A n Rep n C Rep n measurable . 

Let Fac(G) C Rep(G) denote the subset of factor representations. Since G 
is separable by assumption, every factor representation can be realized up to 
unitary equivalence on some Ti n , thus we obtain a canonical bisection 

Fclc(G)/^G , 

which serves to endow G with the quotient structure, the Mackey Borel 
structure. G C G is endowed with the relative structure. Given that this 
construction goes through several steps, it is conceivable that measurability 
questions can become quite tedious. At least we know that the Borel structure 
separates points, i.e. , singletons in G are Borel [35, 7.2.4], Moreover, G is a 
Borel set in G [35, 7.3.6]. 

The next lemma shows sheds some more light on the Mackey Borel struc- 
ture. Its purpose is to identify an arbitrary direct integral, based on some 
standard Borel space, as a direct integral against a standard Borel measure 
on G. Statements of this type are often used implicitly, however we have felt 
the need to clarify this point. This is the purpose of the next statement. 

Lemma 3.15. Assume that (< t x )xex is a measurable field of factor rep- 
resentations of the group G, based on the standard Borel space Y. Then 
T> : X 9 x 1 — > [a x ]~, where [cr x ]f» denotes the quasi- equivalence class, is a 
Borel map into G, endowed with the Mackey Borel structure. 

Proof. In order to relate X to G, let n(x) = dim(7i x ). Using the measurable 
field of ONB’s (‘P x )xex,ne n and fixed ONB’s (V^)i=i,...,n on the H n for the 
7 i x , we can set up a field of unitary equivalences U x : TL X — » TL n (x), by letting 

U X <P = (TWx)C • 

This yields a mapping <P : X — > Fac(G). The measurability of the ONB’s 
implies that the sets X n = {x £ X : dim(7-G) = x} are a measurable partition 
of X, and it is enough to show that is measurable on these. For this property 
we need to check measurability of the mappings 

x ^ {V,$(x)(g)0 = {U*r],a x {g)U*^} , (3.11) 

for all g £ G and rj,f£ Ti n - Now it is straightforward to verify that 

x^Ufrj , x 

are measurable vector fields, hence the measurability requirement on the a x 
yields (3.11). Thus <P is measurable. 

<P is obtained by concatenating <P with the quotient map Fac(G ) — > G, 
which is measurable by the choice of Borel structure on G. □ 
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3.4.2 Central Decompositions* 



Unfortunately no useful decomposition theory, valid for all representations of 
all locally compact groups, can be based on the unitary dual. In this section 
we will see that G provides a certain substitute for this. This substitute has at 
least two shortcomings: The first is the empirical observation that in the cases 
where G and G in fact differ, the latter is virtually impossible to compute. 
Note that already the computation of G for large classes of groups G (e.g., for 
group extensions, nilpotent or exponential Lie groups) marks milestones in 
harmonic analysis of the past fifty years. By contrast, to my knowledge there 
does not seem to be a single group G, not of type I, for which G is actually 
known explicitly. 

The second drawback is the fact that the uniqueness property of the de- 
composition has to be taken with caution. A representation n may be decom- 
posable into factors in several essentially different ways. A uniqueness result 
is only available if we stipulate in addition that the center of the commuting 
algebra, Tt(G)' n7r(G) /, , is decomposed as well. This central decomposition 
is the subject of the next theorem. 

Theorem 3.16. Let n be a representation of G. 

(a) Existence. 

There exist 

• a standard measure on G, 

• a -measurable field of representations (aAtfeG with cr £ 

• a unitary operator T : — * Jg hia^dv^fd) 

such that T gives rise to the following equivalences 



/*© 

7r — I a$dv 1 t (i9) (3-12) 

JG 



7 r(G)' n tt(G)" 







(3.13) 



(b) Uniqueness. 

Let v be a standard measure on G and (ffA'&^G a measurable field of 
representatives, effecting decompositions analogous to (3.12) and (3.13), 
then V is equivalent to v^, and there exists a v^-almost everywhere defined 
measurable field of unitary equivalences between and a$. 

(c) The operator T from part (a) in addition yields 



AG)" 




a#(G)"diyffti) 




affG)' dv^(d) 



(3.14) 

(3.15) 
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Proof. Parts (a) and (b) are [35, 8.4.2]. For (3.14) observe that since G is 
separable, n(G)" is generated, as a von Neumann algebra, by a countable set, 
and tv(G)" r\Tv(G)' consists of the diagonal operators by (3.13). Then [35, A. 88] 
applies to show (3.14). The statement about the commutant follows from this 
aud Theorem 3.9. 

Note that instead of (3.13), one could also require (3.14) to characterize the 
central decomposition. Indeed, (3.15) follows again, and taking intersections 
on both sides, observing that affG)' fl a#(G)" = C • Id > yields (3.13). 

Let us shortly comment on the practical use of the central decomposition. 
The main problem with this decomposition is that it does not work backwards: 
If we have a direct integral representation 

/*® 

7T = / C Tftdv (l?) , 

JG 

the right hand need not be the central decomposition from Theorem 3.16. 
For this it remains to check that n(G)' D 7r(G)" coincides with the diagonal 
operators, which may be rather hard to prove even when it is true. Hence 
the uniqueness statement is not as easily applicable as one might have hoped. 
For instance, it can be shown that every representation can be decomposed 
into a direct integral of irreducible representations (e.g., [45, 7.38]). However, 
if we have started with a factor representation it (not of type I), it coincides 
with its central decomposition, with measure concentrated on { [zr] } C G\G, 
whereas the decomposition into irreducibles is supported in G. Thus we have 
obtained two disjoint supports, and an example of a decomposition which is 
not central. 

Nonetheless, the decomposition of the commuting algebras allows to for- 
mulate the following result relating quasicontainment and absolute continuity 
[35, 8.4.4, 8.4.5]. 

Theorem 3.17. Letiri,^ be representations, and letu nx , v n2 be the measures 
underlying the respective central decompositions. Then 7Ti is quasi- equivalent 
to a subrepresentation of tt 2 iff is absolutely continuous with respect to 
u n2 ■ In particular 7Ti « n 2 iff and v^ 2 are equivalent. 

This yields the following characterization of disjointness. Recall that two mea- 
sures on the same space are called disjoint if every set is a nullset with respect 
to at least one of them. 

Corollary 3.18. Let 7Ti , 7T2 be representations, and let v^ 1 , v n2 be the mea- 
sures underlying the respective central decompositions. Then 7Ti and n 2 are 
disjoint iff u Vl and u n 2 are disjoint measures. 

3.4.3 Type I Representations and Their Decompositions 

From the discussion so far one might expect that a decent decomposition 
theory is obtained by considering those representations whose central decom- 
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position is supported on G. This intuition actually works, and the represen- 
tations which fall in this category can be characterized in a way which does 
not directly refer to the central decomposition. 

Definition 3.19. A representation tt is called multiplicity-free if tt(G)' is 
commutative, tt is called type I if it is quasi-equivalent to a multiplicity-free 
representation. 

Multiplicity-free representations owe their name to the following charac- 
terization: 

Proposition 3.20. Given a representation tt, the following are equivalent: 

(a) tt is multiplicity- free. 

(b) There exists a standard measure u n on G such that 

/*© 

tt — I a dvcfu) 

Jd 

as well as 

tt(G)' ~ f C • Id w „ dv G {a) . 

JG 

In other words, the central decomposition of tt is supported on G, and each 
<7 £ G occurs with multiplicity (at most) one. 

A combination of Proposition 3.20 and Theorem 3.17 yields the following 
criterion. 

Theorem 3.21. Let n be a representation, and the associated measure of 
the central decomposition. Then tt is type I iff v„(G \ G) =0. 

As a corollary, we find that we can split each representation into a well- 
behaved and a pathological part. 

Corollary 3.22. Let tt be a representation. Then = 'H I 7T ®'H I 7T L , where the 
corresponding restrictions tt 1 and tt 11 - are disjoint representations, and every 
invariant subspace carrying a type I subrepresentation is contained in Ti(. 

Proof. Note that the characteristic functions of the measurable sets G and 
G\G give rise to projection operators in the commuting algebra, acting as 
pointwise multiplication on the central decomposition side. This yields the 
two invariant subspaces. The disjointness statement follows from 3.17. 

For type 1 groups, the decomposition theory takes the expected form. The 
following theorem relates the type I property to the regularity of the dual. 

Theorem 3.23. For a second countable group G the following are equivalent: 

(a) G is type I. 

(b ) Every representation of G is type I. 
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(c) G is a standard Borel space. 

Proof, (a) =>• ( b ) follows from Theorem 3.21, since v(G \ G) = 0 is trivial by 
assumption. The converse is clear: If G is not type I, there exist factors which 
are not of type I. For (a) (c), confer [45, Theorem 7.6]. 

Theorem 3.24. Let ir be a representation of the type I group G. 

(a) There exists a standard measure on G and a multiplicity function m „ : 
G — > No U {oo} such that 

/•® 

7r — I m w (a) ■ a dv n (a) . (3.16) 

JG 

(b) The unitary equivalence effecting (3.16) also induces a decomposition of 
the von Neumann algebras associated to 7 r, yielding 

ffG)' ~ r 1 ® B(e 2 (I mAa) )) dnffa) 

JG 

and 

tt(G)" ~ [ B{H a ) <g> 1 dv w (a) . 

JG 

Next to the uniqueness statement. The formulation of the following theo- 
rem may seem excessively general, involving arbitrary Borel spaces. However, 
it implies that it is enough to realize that a certain direct integral decom- 
position, not necessarily based on a subset of the dual, is the unique direct 
integral decomposition into irreducibles, after a suitable identification of the 
underlying measure space. The fact that the identification comes in the form 
of a Borel isomorphism onto a suitable subset of G is part of the statement. 
Moreover, it shows that any decomposition of a representation of a type I 
group into a direct integral of irreducible representations is in fact the cen- 
tral decomposition, unlike the case we sketched at the end of the previous 
subsection. 



Theorem 3.25. Let G be a type I group. Let X be a standard Borel space 
with measure u, and (cr x ) xe x a measurable field of irreducible representations 
of G satisfying a x <j y for x y. Let m : X — > No U {oo} be measurable, and 
define 



it 



\ 



m(x) • a x dv(x) . 



Assume that n has the central decomposition 



?n T (cr) • a du n (a) 



(3.17) 
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Then the injective mapping <P : x i— > [<j x }~ is a Borel isomorphism from X 
onto a Borel subset of G, is equivalent to the image measure of v under <P, 
and to = o<P (nu„- almost everywhere). Now the uniqueness statement of 
[35, 8.6.6] yields the rest. 

Proof. By assumption, <L> : X G is an injection. Moreover, since the field 
of representations is measurable, <P is measurable also, by 3.15. Since it is 
an injective mapping between the standard spaces X and G, 3.3 that it is a 
Borel isomorphism onto a subspace of G, and the image measure is a standard 
measure on G. 

As a consequence of the uniqueness theorem, we obtain the containment cri- 
terion. 

Theorem 3.26. Let tt, g be two type I representations, and let v m v , v e , 
m e denote the associated measures and multiplicity functions. Then tt < g iff 
Un is v g - absolutely continuous, with to „ < m e , v^-almost everywhere. 

Proof. The ” if” -part is straightforward: If m n (a) < m e (a ), then there is a 
canonical embedding £ 2 {I m „(a-)) C £ 2 (/ m (a))- This can be used to construct 
a canonical isometric intertwining operator 

To : 0 £ 2 (/ m „ (CT) ) Tio ® ■ 

It is elementary to check that this is a measurable field of intertwining oper- 
ators. 

For the ”only-if” part we identify g with its central decomposition, i.e 

/*© 

g= m e (a) ■ a dv e (a) . 

Jg 

Then tt is equivalent to a restriction of g to some invariant subspace K. The 
projection onto K, is in g(G)', thus given by a field (lgiP^) g. This establishes 
that 

/*© 

tt — I m 7r (cr) • a du 7T (a) , 

Jg 

where = rank(P CT ) < m g (a). Moreover, every intertwining operator 

on K. is decomposed (it intertwines g), thus we have obtained the central 
decomposition, by the remark following Theorem 3.16. 

We observe that the irreducible subrepresentations of a representations 
correspond to the atoms of the measure underlying the decomposition of tt 
into irreducibles. 

Corollary 3.27. Let G be a type I group, and tt a representation with tt ~ 
Jq m w (a) ■ a du n (a). Then ctq € G is contained in tt iff v^{{ct q}) > 0. 
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3.4.4 Measure Decompositions and Direct Integrals 

The direct integral decompositions obtained in the later chapters are not so 
much constructed but recognized as direct integrals. By this we mean that 
the initial representation space 7i n is mapped into a suitable L-space, and 
then the latter is seen to be a direct integral by use of a measure decomposi- 
tion. This is a geometrically intuitive way of viewing direct integrals, already 
used by Mackey [87]. We have already encountered a particularly simple ex- 
ample in the discussion in Section 3.1: The unitary equivalence (3.7) was 
obtained by identifying the function / £ L 2 {U) with the family of sequences 
((/(w + k/a)) ke z) we[0il / a [, yielding a unitary equivalence 



L 2 (U) ~ / £ 2 (/J duj . 

J[ 0,l/a[ 

The identification is unitary because of the simple equality 

[ l/M| 2 dw= f Y2 \.f{u + k/a)\ 2 duj 

d u J[0,l/a[ ke i u 

which we interpret by an integral first over the set u> + / Q , and then an in- 
tegral over [0, l/a[. But this is nothing but a measure decomposition (or 
disintegration) of Lebesgue measure on U, along the partition given by the 
sets {w + k/a : k £ I u }, where u> through [0, l/a[. 

Before we show that this procedure works generally, let us give criteria for 
the existence of measure decompositions. Again the regularity conditions for 
Borel spaces prove useful. 

Proposition 3.28. Let be a standard measure space. Let 1Z be an 

equivalence relation on X, such that X/1Z is a countably separated measure 
space. Then there exists a Borel measure JJ on X/1Z and on each equivalence 
class [x] a measure such that for all Borel sets B C X, the mapping 

(j)B '■ X/1Z B [ x \ i— > i 'a{[%\ H B ) 

is Ji-measurable on X/1Z and fulfills 

[ <t>B{[x])dp([x]) = p(B) . 

JX/TZ 

The measure class of Jl is unique, and given a fixed choice of Ji, the vua are 
uniquely defined (JI-almost everywhere). 

Proof. See [40, Lemma 4.4] 

The following proposition tells how to read certain representations act- 
ing on an L 2 -space with measure decomposition as direct integrals. The 
representation-theoretic part was also used in Section 3.1. 
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Proposition 3.29. Let i r be a representation of G acting on H „ = L 2 (A, g?/x; 
Ho), with (X, /x) standard. Suppose that there exists an equivalence relation 
1Z on X such that X/1Z is standard, and let {v[ x ])[x\ex/Ti an< i ft be a measure 
decomposition as in Proposition 3.28. 

(a) Let f £ L 2 (X, dp;Ho), then, for Jl-almost [x] £ X/1Z, f |j x ] £ L 2 ([cc], vy.y 
Ho)- This gives rise to a unitary equivalence 

/*® 

L 2 (X, dp,; Ho) — / L 2 ([x\,dv [x y,H 0 )dJl{[x ]) . 

Jx/n 

(b) Assume moreover that there exist unitary representations {<J[x])[x\ex/Ti, 
with <7[ x ] acting on L 2 ([a;], V[ x y Ho), such that for all f £ H n and Jl-almost. 
all [. x ] £ X/G, we have 

{n(y)f)\[ x ] = n [x] (y)(f\ [x] ) . 

Then the operator S from (a) implements a unitary equivalence 

r © 

7T- / V{x\dp[x] ■ 

JX/TZ 

Proof. This is a special case of [40, Lemma 4.5]. As a matter of fact, only the 
equivalence in part (b) is given there, but a closer look at the proof shows 
that the intertwining operator is obtained by the construction in (a) . 



3.5 The Plancherel Transform for Unimodular Groups 

Plancherel theory describes the decomposition of the regular representation 
into a direct integral of irreducible representations. We already know that such 
a decomposition exists if we only assume that G (or, more generally, Xq) is 
type I. In this connection, we give a formal definition of the term ’’Plancherel 
measure” . 

Definition 3.30. Let G be a second countable locally compact group with type 
I regular representation. A standard measure uq on G is called Plancherel 
measure if it yields the central decomposition 

P® 

Xq — m(cr) ■ <7 dvcicr) ■ 

Jg 

It follows from the results in Section 3.3 that Plancherel measures exist, 
and that all Plancherel measures are equivalent. If Plancherel theory is only 
understood in the sense of providing some deomposition of the regular repre- 
sentation, the answers given in section 3.3 are thus wholly sufficient. However, 
the special feature of the Plancherel theorem below is that it gives a concrete 
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description of the intertwining operator implementing the decomposition, as 
well as the fibre spaces in the direct integral decomposition. In addition, for 
unimodular groups it will be possible to single out a particularly useful choice 
of Plancherel measure from the equivalence class. 

The key turns out to be provided by the operator- valued Fourier trans- 
form: As in the case of the reals, the construction of the Plancherel transform 
for a type I unimodular group proceeds by first defining a Fourier transform on 
L 1 (G) and extending it (with suitable modifications) to L 2 (G). The operator- 
valued Fourier transform (or group Fourier transform) on G maps each 
/ € L : (G) to the family T{f) = (o’(/)) CTe g of operators, where each a(f) is 
defined by the weak operator integral 

cr (/) : = [ f(x)a(x)dx . (3.18) 

JG 

This defines a field of bounded operators, in fact, a simple estimate establishes 

lk(/)lloo < ll/lli • (3.19) 



Indeed, 







f(x)((r(x)ri,<p)dx 



< J \.f(x)\ \(<r(x)r),<p)\ dx 

<\\f\\i\\v\\ INI • 



Note that the definition of T is entirely analogous to the definition of the 
Fourier transform over the reals, by the usual parametrization of R. 

Another simple computation shows the convolution theorem on L 1 (G), 
namely the fact that convolution becomes operator multiplication on the 
Fourier side: 

°{f * g) = <r(f) ° a{g) ■ (3.20) 

This is justified by 



M/ * g)Vi = / (fastg)(x)(cr(x)r),<p) dx 



/ / f(y)g(y 1 x)(a(x)r],ip} dy dx 
Jg Jg 

/ / f(y )/ g(y~ 1 x){a(x)y,tp) dx dy 

JgJg Jg 

/ / f(y) g(x)(a(y)a(x)r],tp) dx dy 
JgJg Jg 

f [ f(y) [ g{x){a(x)r],a(y)*ip) dx dy 
JgJg Jg 
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= / f(y)(<r(g)v,v(y)*<p) dy 
Jg 

A similar computation establishes for / G L 1 (G) and g(x) = f{y~ 1 xz) 

<?{g) = a{y)o{f)(j{z)* , (3.21) 



if the group is unimodular. 

While in the real case there is a natural Hilbert space to contain the images 
of L 2 (R)nL 1 (K) under the Fourier transform, namely L 2 (R), in the nonabelian 
case this Hilbert space needs to be constructed. We have spent the previous 
sections mainly with providing the elements of this construction: The Fourier 
transform (cr(/)) o . g g forms a held of bounded operators, indexed by elements 
of G. Furthermore, this held is measurable, as follows from the definition of the 
Mackey Borel structure on G, and it intertwines the action of the twosided 
regular representation with the canonical action from left and right. It is 
thus reasonable to expect H to be the direct integral over the measure space 
(G,ug), with vq the measure underlying the central decomposition of Xq- 
The natural choice for the hbres is given by the Hilbert-Schmidt operators 

The following Plancherel theorem contains the rigorous formulation of 
these facts; see [35, 18.8] for a proof. 

Theorem 3.31. Let G be a unimodular type I group. There exists a Plancherel 
measure vq on G with the following properties: 

(a) For all f G L 1 (G) flL 2 (G), a(f) G B 2 {'H a ), for VQ-odmost all a £ G, and 



ll/lll = /JK/)ll! dn G (a) . 

Jg 

(b) T extends uniquely to a unitary operator 


(3.22) 


V : L 2 (G) — » r dv G (cr) , 

Jg 

the Plancherel transform of G. 

(c) V implements the following unitary equivalences 


(3.23) 


Xa ~j 


rW 

' a <S> 1 dvG{cr) 
G 


(3.24) 


80 


r® 

f 1 ® a dvG{&) 

G 


(3.25) 


VNi{G) ~ j 


f B(7i a ) ® 1 dvcip) 

G 


(3.26) 


VN r (G) ~ j 


f \®B(H a ) dvc^) 

G 


(3.27) 
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(d) v G satisfies the inversion formula 

f(x) = f trace(/(cr)cr(:r)*) dv G (a) , (3.28) 

Jd 

for all f in a suitable dense J C L 2 (G). Either of (3.22) and (3.28) fixes 
v G uniquely. 

We call the choice of u G fulfilling (3.22) and (3.28) the canonical choice 
of Plancherel measure for G. One obvious requirement for the space J 
is that the integral in (3.28) converges in a suitable sense. A possible choice 
is the space spanned by (L 1 (G) n L 2 (G)) * (L 1 (G) D L 2 (G)) [45, p. 234]. A 
substantial part of Chapter 4 will be concerned with the proof of Theorem 
4.15 containing a precise description of the scope of (3.28), and a version for 
nonunimodular groups. 



Remark 3.32. In the following, we use ~ to denote the Plancherel transform, 
which should not be confused with the Fourier transform. The direct integral 
Hilbert space on the right hand side of (3.23) is denoted by B®. The scalar 
product of two elements A, £ B®, i = 1,2, consisting of the measurable fields 
(Aj(cr) £ B 2 CHa)) ae Q, is thus given by 

(Ai,A 2 )g®= / trace (Ai(ct)A 2 (ct)*) du G (a). 

2 Jg 



Given an element T £ VNfiG), the operator field corresponding to it accord- 
ing to (3.26) is denoted by {T„ ® 1 ) cre Q, and we write T ~ (T a (g» l) (Tg g- We 
define the analogous notation T ~ (1 (g> T a ) q for T £ VN r {G). 



Remark 3.33. Since we use the toy example G = R as orientation, it is in- 
structive to see how the reals fit into the general scheme. This can be seen 
using the following dictionary: 



unitary dual 
Fourier transform 
G ct 

Plancherel measure 



projection field (P CT ) 



aeG 



~ M, via K9wn^:=e 27na ” 
Hf){u) = J m f(x)xu(x)dx 
Idc 
du 

L 2 (K)=|C(ia 

U CR 



Most of the table is self-explanatory, maybe except for the last two lines. 
Since the representation spaces of the characters are one-dimensional, the 
corresponding Hilbert-Schmidt-spaces (or tensor products) are again conve- 
niently identified with C. Measurable complex-valued functions on R can thus 
be viewed as measurable fields of operators C — > C. This allows to view L 2 (R) 
as direct integral of one-dimensional operator spaces, and to view the charac- 
teristic function \ G as a field of projections 
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p = f Id c for cr eU 
a \ 0 otherwise 

In particular, Theorem 2.63 is now easily recognised as a special case of Corol- 
lary 4.17. 

Finally, we observe that inserting 

trace(/M X M)*) = /( = f(u)e 2 ™* 

into the inversion formula (3.28) yields the well-known Fourier inversion for- 
mula 

f(x) = [ f(u)e 2 ™ x dw . 

J R 



Note that this inversion formula holds for all / € L 2 (R) with / G L 1 (K), 
which is the natural domain for inversion formulae. The analog of this space 
for nonabelian groups is described in Chapter 4. 

The following remark explains how the discrete series representations fit 
into the Plancherel picture. 

Remark 3.34 ■ By 3.27 it is clear that ir G G is in the discrete series iff 
MM) > 0. Let r),ip,rf,if/ G and consider the rank-one operators 
A n = ip<g>r] and B = ip' Since {ir} is Borel, we can extend these trivially 
to measurable operator fields (A cr ) crg g G £>® and {B a ) q. Let a,b G L 2 (G) 
denote the respective preimages under the Plancherel transform. Assuming 
that the inversion formula (3.28) is applicable, we find that 

a(x) = / trace(A a a(x)*) dv G {cr) = UG{{n}){tp,ir(x)r)} = VG(M)Vriip(x) , 
Jg 

and likewise for b. Note that here the absolute convergence of the integral 
is trivially guaranteed; this fact allows us to justify the use of Plancherel 
inversion by referring to Theorem 4.15 below. Since Plancherel transform is 
unitary, we obtain 

{V v <p,V v 'ip') = v g {{t: })~ 2 {a,a') 

= MM)" 2 [ trace(A (T B*)dh , G (a) 

JG 

= MM)- 2 (^M)(?/,?7) ■ 

A comparison of this equation with the orthogonality relation (2.15), observing 
in addition that CV = • Id-^ , yields that 

Ctt = MW ) -1 • 

In particular, computing the constant c n , which is the only step necessary for 
establishing admissibility conditions, is equivalent to computing the canonical 
Plancherel measure of the singleton set {ir}. 
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3.6 The Mackey Machine* 

In this book the Mackey machine is the chief technical tool for the computa- 
tion of duals and Plancherel formulae. It serves two purposes: On the one hand 
we need Mackey’s theory to obtain an explicit description of the Plancherel 
measure of a nonunimodular group, using the unimodular normal subgroup 
N = Ker(Z\). Moreover, the examples given in Chapter 5 all rely on computa- 
tion of Plancherel measure for group extensions, which is based on Mackey’s 
theory. We therefore include a short survey, which will also allow to fix some 
notation. For a more complete exposition we refer the reader to [45] . 

Let G be a locally compact group, and N <\G closed. Then G operates on 
N by conjugation, i.e. 

x.n = xnx -1 

is a left action of G on N by automorphisms. This gives rise to a left action, 
the dual action of G on N, if we let (x.a) denote the representation acting 
on TL a by 

(x.a )(n) = a(x~ 1 .n) = a(x~ 1 nx) . 

Clearly N acts trivially on N, since cr(n) acts as intertwining operator between 
a and n.a, if n £ N. Hence we obtain an action of the factor group H = G/N 
on G, which is also called the dual action. Given 7 £ N, the associated 
stabilizer in G is denoted by G 1 . The little fixed group H 1 denotes the 
quotient G 1 /N. In the case that G is a semidirect product G = N x H, 
the U 7 can be identified with subgroups of H. The associated dual orbit is 
denoted by 0( 7 ). The dual action respects the Mackey Borel structure, more 
precisely, N is a Borel G-space. In particular, whenever N is type I, N is 
standard, and then 3.3 implies that 0( 7 ) = G/G 7 = H/H 1 as Borel spaces. 
This identification will be used later on frequently in the discussion of quasi- 
invariant measures on the dual orbits. 

The discussion somewhat simplifies if G is in fact a semidirect product 
G = N x H. This is the case if H can be identified with a closed subgroup 
of G, i.e., there exists a cross-section G/N — > G which is a continuous group 
homomorphism. Then we can write elements of G as pairs (n, h), with group 
law (n, h)(n' , h') = ( na^(n '), hh'). Here ah is the automorphism of N obtained 
by conjugating with h. In this setting the little fixed group H 1 is also a 
subgroup of G, and G 7 = N x H 1 . 

The following regularity condition on the dual orbit space turns out to be 
central for the complete description of the dual of a group extension. 

Definition 3.35. Let N < G and H = G/N . N is called regularly embed- 
ded if the quotient space N/H is countably separated. 

We can now state the objectives of Mackey’s theory. Given a group exten- 
sion N <\ G fulfilling certain additional assumptions, we want to compute G 
from the following data: 
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• the dual orbit space N/H 

• for each 7 € N, the associated little fixed group iJ 7 and its dual H 7 

The procedure which allows to construct all elements of G from these ingredi- 
ents is induction. There exist several realizations of induced representations; 
for our purposes the most useful one uses cross-sections. For a proof, see for 
instance [50, Proposition 2.6.3]. A version for right cosets instead of left ones 
may be found in [75]. 

Proposition 3.36. Let G be a locally compact group and H < G. Suppose 
that g is a representation of H. Pick a quasi-invariant measure g on G/ H , 
and let 

LL-k := L 2 (G/ H, y, Ha) ■ 

Given x £ G, define the measure g x by g x (E) = g(Ex). Let a : G/H — > G 
denote a Borel-measurable cross-section. Letting 



(n{x)f) ( yH ) := y 1 {yH)cr ( a(yH ) 1 xa( x 1 yH)) f(x 1 yH ), (3.29) 

defines a unitary representation w with n ~ bidder. 

We will not give Mackey’s theorem in its most general form, since this 
would necessitate to discuss projective representations. The following defini- 
tion formulates the technical condition which allows to avoid this. 

Definition 3.37. Let N < G, and a £ N. If a can be extended to a unitary 
representation of G a on H a , it is said to have a trivial Mackey obstruc- 
tion. 

Remark 3.38. Let us explain the notion of Mackey obstruction some more. For 
simplicity assume that G = N x H, and let a £ N. Then for every h £ H a 
there exists a unitary operator T{h) : » Her intertwining a and h.a. 

Hence cr(ah(n)) = T(h)a{n)T(h)* . By Schur’s lemma, T(h) is unique up to 
an element in T. Now the Mackey obstruction is trivial precisely if we can 
choose the mapping h 1— > T(h) to be a homomorphism. 

For the purposes of Chapter 5, we introduce an auxiliary notion. Given a 
semidirect product G = N x H , we say that the Mackey obstruction of a £ N 
is particularly trivial if (n, h) 1— > a(n) is a representation of G 1 = N x H 1 . 
Let us mention two cases where the obstruction is particularly trivial: If N is 
abelian, then T{h) and c(n) commute, as linear operators on one-dimensional 
space. Hence we may as well choose T(h) = 1. The other, even more obvious, 
case is N = G 1 . These two cases cover all examples in Chapter 5. 

The following theorem shows how the induction procedure allows to com- 
pute the duals of group extensions with regularly embedded normal subgroup. 
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Theorem 3.39. [Mackey] 

Let N < G, and assume that all <j £ N have trivial Mackey obstruction. 

(a) Given 7 £ N, let 7 denote a fixed extension of N to G 1 . Given g £ H 7 , 
let 

(7 x e){y) : = 'y(y)e(yN) . 

This defines a representation of G 7 which satisfies Indg 7 x g £ G. 

(b) Let N < G be regularly imbedded, with N is type I. Pick a measurable 
transversal £ C N of N/H. Then the Mackey correspondence 

{{ 1 ,g): 1 ££,g£H 1 }->G (3.30) 

(7, g) i-> Indc 7 7 x g (3.31) 



is a bijection. 

(c) Suppose that N is regularly embedded and type I. Then G is type I iff all 
the H 1 are. 



We remark that N need not be regularly embedded for G to be type I, as 
witnessed by a counterexample in [17]. 

Besides allowing to derive all of G by brute force calculation, Mackey’s 
theory also provides a geometric intuition which can be exploited for various 
purposes. More precisely, the Mackey correspondence allows to view G as 
a fibred set 



G= U {Ind^er x g : g £ H a } = |J {a} X H a 

0(a)eN/H 0(a)eN/H 



with base space N/H and fibre {0(a)} x H a = H a associated to 0(a) £ 
G / H . This view allows an educated guess concerning the Plancherel measure 
of G: All fibres carry respective Plancherel measure, which can be ’’glued 
together” using a pseudoimage of vq under the projection map N -4 N/H. 
The following theorem shows that this construction works. Note that it is 
somewhat more general than the version of Mackey’s theorem given above, 
since 3.40 only requires good behavior of the dual action on a conull set. An 
even more general version can be found in [75, 1, Theorem 10.2]. The procedure 
for obtaining the correct normalization of the canonical Plancherel measure 
for the case that G is unimodular follows from [82, Clr. Ill, Theorem 6]. 

Theorem 3.40. [Kleppner/Lipsman] 

Let G and N <\ G be type I. Suppose that N is unimodular and regularly 
embedded, and that there is a G-invariant Borel conull subset £ C N such 
that all a £ £ have trivial Mackey obstruction. Then a vc-conull subset of G 
is given by the set 

(J {Ind^cr x g : g £ H a } = |^J {a} x H a . 

0(a)eS/H 0(<T)eS/H 
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The class of Plancherel measure is obtained by the following procedure: Pick 
a pseudo-image Vr of vr on E/H. Then there exists, for almost all 0 ( 7 ) € 
E /H, a normalization of Plancherel measure vr^ (which is necessarily unique 
in the unimodular case) such that 

dv G = dvH^diJW . (3.32) 

For G unimodular, the correct normalizations are obtained as follows: 

• There exists a unique family of measures Po(-y) on the G-orbits in E such 
that 

dp, 0 {-y)dl7E(0( 7 )) = dv N (j) . 

• Since G is unimodular, the Po(-y) are H -invariant, at least VR-almost. ev- 
erywhere. Hence there exists a unique choice of Haar measure p.R^ such 
that Weil’s formula 

dp N dp Hl dp 0 ^ = dp G 

holds. 

• Normalizing vr according to the choice of \ir in the previous step en- 
sures (3.32). 

Since discrete series correspond to the atoms with respect to Plancherel 
measure, the following result follows directly from the fibred measure theorem 
of Kleppner and Lipsman: 

Corollary 3.41. Let G and N <\G be as in Theorem 3-4-0. Then n is a discrete 
series representation iffn = Indg^ux g, where a G N is such that vr(0{o)) > 
0 and g is in the discrete series of H a . 

For the sake of illustration, let us discuss the theorems for the groups from 
Section 2.4. 

Remark 3-42. Consider the group H r = R 2 x T as in Example 2.27, with the 
group law 

(P, h z)(p', q', z') = (p + p\ q + q', zz’^Wv-cv')) , 

and inversion (p, q, z) -1 = (—p,—q,z). Then N = {0} x I x T is an 
abelian normal subgroup, and the dual group is parameterized by R x Z, via 
X(w,n)(0, q, z) = z n e~ 2muiq . Letting H = Rx{0}x{l},we see that H r = NxH, 
and the conjugation action of H on N is given by 

C P , 0, 1) (0, q, z)(-p, 0 , 1) = (p, 0 , l)(-p, q, ze 7riqp ) = (0, q, ze 2 ” ipq ) . 



The dual action is then computed as 



[{p, Q, z).X(u,n)] (9o,-o) 
= z(fe 27vmpq °e _27r!w ® 



[(P> 0, l)-X(w,ra)]( < Z0; ^o) 
X(« —np, n) (90,20) • 



(u,n)(q 0 ,z 0 e 2mpq ) 
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Therefore, the dual orbits are given by 

O (u ,o) = {(<*>, 0)} ,w£l 

O n = Rx {?r} , n € Z \ {0} . 

The little fixed groups associated to the orbits are H in the first case, and 
trivial in the second case. Thus Mackey’s Theorem yields 

C = {oy, s : r, s € M} (J{7r fc : k e Z \ {0}} . (3.33) 

Here oy jS (p, q. t) = e ~ 2m ( r P+ sl i) ^ the characters of the quotient group G/ ({0} x 
{0} x T, and 7 t*, = Ind® r Xo,fc- Identifying R. x {n} with R, and observing 
once again that the representation of to be induced acts on C, we realize the 
induced representations on L 2 (R), using the cross-sections a : R — > H r given 
by a(u>) = (— u)/n, 0, 1). We note that Lebesgue measure is in fact invariant 
under the shift action in formula (3.29), hence the Radon-Nikodym derivative 
equals one. Computing 

z ) a ((P, d, zy 1 ^) = ( u/n , 0, 1 )(p, q, z)a(w + np) 

= y/n, 0, 1 )(p, q, z){-u/n - p, 0, 1) = (0, q, ze ^/*+p/ 2 )) 

Plugging this into (3.29) yields 

7r fc (;p, q, z)f(u) = X(o,fc)(0, q, ze^W+^fiu, + kp) = z^^+pk/i) _ 

Comparing this to Equation (2.19), we see that 7r_i is identical to the repre- 
sentation 7 r considered in Example 2.27. In order to establish that the repre- 
sentation is in the discrete series (which is of course known by the discussion 
in 2.27), we next compute Plancherel measure, or at least its measure class. 
The Plancherel measure on N = M x Z is dojdn, where duj is Lebesgue mea- 
sure, and dn counting measure. It is obvious that taking Lebesgue measure on 
the continuous part of G (i.e., on the {cr r s : r,s £ R}) and counting measure 
on the complement is a pseudoimage of this. This yields the measure class; in 
particular, !/<?({ 7r_i}) > 0 establishes once again that the representation from 
Example 2.27 is in the discrete series. Moreover, our discussion has provided 
the additional discrete series representations { 77 ^- : k ^ 0, — 1}. 

Remark 3-43. There are different possible ways of viewing the reduced reduced 
Heisenberg group as a group extension. However, not every possibility allows 
to apply Theorem 3.39. For instance, consider the central subgroup Z = {0} x 
{0}xT. Then clearly Z<\G , with G/Z = R 2 . Since Z is central, the conjugation 
action of G on Z is trivial, and so is the dual action. It follows that G 1 = G 
for all 7 eZ. Assuming that all Mackey obstructions were trivial, this would 
imply that all irreducible representations are extensions of elements of Z . 
Thus they would act in onedimensional spaces, i.e. all elements of G would 
be lromomorphisms G — > T. Since G separates points, this would imply that 
G is abelian, which it is not. 
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Remark 3-44- Let G be the ax + &-group, G = R M 1' from Example 2.28. 
A more detailed study of the representations of this group, including the 
Plancherel formula, may be found in the papers by Khalil [71] and Eymard 
and Terp [42] . These papers may also be considered as precursors to the results 
of Kleppner and Lipsman, and Duflo and Moore, on the Plancherel formula 
for general nonunimodular groups. 

The arguments given here for the ax + Regroup will be applied to general 
semidirect products in Chapter 5. The role of the normal subgroup N is played 
by the subset {(&, 1) : 6 € R}, whereas the quotient group is isomorphic to the 
subgroup {(0,a) : a € R'} = R'. Using 

(0, a)(b, 1) (0, a -1 ) = (a&,l) 



we find that 

(a-Xu)(b) = = e~ 2ma lbuJ = Xa- i u (b) ■ (3.34) 

Thus we have two dual orbits in N = R, namely {0} and R', with associated 
fixed groups G and N, respectively. The trivial representation of N, which 
corresponds to the orbit {0}, clearly extends to the trivial representation of 
G. Hence the trivial orbit contributes the representations 

Qt(b, a) = assign (a) e (t £ R + , e £ {0, 1}) , 

which is just the dual of the quotient group G/N = R*. 

We pick x l £ N as a representative of the other orbit. It is clear from 
(3.34) that the little fixed group is trivial, thus the orbit contributes precisely 
one more representation 

a = Ind^xi . 

Noting that xi Las C as representation space, we realize n on the space 
L 2 (R, dx), using the cross-section a : R' — > G given by a(u>) = (0,w -1 ). 
With a view to evaluating (3.29) we compute 

a(w) _1 (6, a)a((b, a) -1 , w) = (0, <x)(b, a)(0, a -1 w -1 ) = (w6,0) . 

Plugging this into (3.29) yields 

[a(b,a)f](uj) = |a| 1 / 2 e _27rifew /(aw) . 

Note that the factor \a\ 1 ^' 2 is the Radon-Nikodym derivative term in (3.29), 
as it serves to making a(b, a) unitary. 

A comparison to Example 2.28 shows that a, being the only infinite- 
dimensional irreducible representation of G, must be equivalent to the ir- 
reducible representation it which we studied in 2.28. A straightforward com- 
putation shows that 

(tt(6, a)f) (u) = e~ 2n ' ub \a\ 1/2 f(auj) = (a(b, a)fj (w) , 
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which means that the Plancherel transform on L 2 (R) intertwines a and n. 
This is also our reason for realizing Ind^Xi on L 2 (R, dx ), instead of choosing 
the measure \x\~ x dx, which is invariant under the dual action. The induced 
representation would look slightly simpler, but the unitary equivalence to the 
representation from 2.28 is less easy to see. 

We next turn to the Plancherel measure, which is a rather easy exercise: 
i/jv is supported on the conull orbit R\ which contributes the representation 
a. Now Theorem 3.40 yields that, since the other orbit {0} has measure zero, 
the Plancherel measure of G is supported in {cr}. In other words, the 

Xg — oo ■ <7 , 

and the Plancherel theorem implies that 

/ - <?{f)C a 

defined on L 1 (G) fl L 2 (G), extends to a unitary operator L 2 (G) — > B^iHa). 

The similitude group considered in Example 2.30 can be treated much in 
the same way. Again the dual action has two orbits, {0} and its complement, 
and on the latter, the action is free. As for the ID case, this implies that 
Xg — oo ■ cr, for a single irreducible representation a. 

The following remark dealing with the dyadic wavelet transform can be 
seen as a precursor to the discussion in Chapter 5, in particular the first three 
sections therein. 

Remark 3.^5. Finally let us consider the 2 k x + 6-group underlying the dyadic 
wavelet transform. Since this is a subgroup of the ax + 6-group containing R, 
we obtain the same dual action as in Remark 3.44, which yields the following 
orbit space 



{{2 k x : fc € Z} : xG ±[1, 2[U{0}U} = ±[1, 2[U{0} 

The associated little fixed groups are trivial for orbits different from {0}, 
whereas the little fixed group of the latter is obviously Z. Thus we find that 

G = {x 7 : 7 € [0, ![} U {a u : lo e ±[1,2[} , 

with X7(6, k) = e~ 2m ' lk , and a u = Ind^w. Proceeding as in the previous 
example, we realize a u on f? 2 (Z), yielding 

cr u (6, k)f(n ) = e 2mujn f(n — k) . (3.35) 

Let us describe the Plancherel measure. The group being nonunimodular, only 
the measure class will be of interest. We may safely ignore the representations 
X 7 , since they correspond to the orbit {0} which has zero measure. For the 
complement, the fact that the dual action is free there implies that it remains 
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to compute a pseudoimage of Plancherel measure on R under the quotient 
map associated to the dual action. Clearly Lebesgue measure on 

±[1,2[= K,:a;e±[l,2[} 

serves this purpose. As a first simple observation we note that this measure 
does not have atoms, and hence G has no discrete series representations. 

Let us now consider the quasi-regular representation 7r from Example 2.36. 
We already know that n has admissible vectors, and we want to express this 
in terms of Plancherel measure. For this purpose we compute the action of 
the representation n obtained by conjugating 7 r with the Fourier transform. 
In the last remark, we have already computed this action for the full affine 
group, obtaining 

(7f(6,fc)/)(u;) = |2| fc / 2 e-“/(2M . (3.36) 

In order to relate this to the Plancherel decomposition, we associate to each 
£ € ±[1/2, 1[ the Hilbert space 7ft = £ 2 (2 Z £, 2 fe dfc). That is, elements of 
f 2 (2 z £,2 k dk) are sequences indexed by {2 fe £ : k £ Z} which are square- 
summable w.r.t. (weighted) counting measure. The motivation for this def- 
inition is that if we parameterize R' by ±[l,2[xZ 9 (£, k) i— > 2 k £. Lebesgue 
measure is then given by d£2 k ~ 1 dk, with d£ Lebesgue measure on the intervals, 
and dk counting measure. Hence any element of L 2 (R) corresponds uniquely 
to a family (/| 2 z j){e±[i, 2 [) yielding a unitary equivalence 

L 2 (R) ~ [ 7ft . 

H1.2[ 

As a matter of fact, this argument is yet another instance of the general pro- 
cedure of viewing a measure decomposition as direct integral decomposition 
of the associated L 2 -spaces, confer Subsection 3.4.4. The relevance of this par- 
ticular decomposition is that a second look at (3.36) convinces us that we also 
have a decomposition of representations, 

7T — / 7T t(f£ 

J±[ L2[ 



where the action of on 74/ is 

(7T#, k)f) (u) = |2| fe / 2 e-“/(2M . (3.37) 

Now the comparison to (3.35) allows to check immediately that the operator 
7/ : £ 2 (Z) — > 7ft, defined by 

(W)) (2 fc o = 2 k/2 m 



intertwines with 7Tt. Thus we arrive at 




3.7 Operator- Valued Integral Kernels' 



93 



y® 

7T — / crcd( , 

J±[ 1,2[ 

and the right-hand side is a multiplicity-free direct integral representation 
with Plancherel measure as underlying measure. Thus we have established 
7 t « Ag- In particular, 7r has no irreducible subrepresentations either, a fact 
we have already derived by other means in Example 2.36. 



3.7 Operator-Valued Integral Kernels* 

The Plancherel formula for nonunimodular groups is obtained by applying 
the results of the previous section to the normal subgroup N = Ker(Z\c). 
This involves explicit calculation using induced representations, and operator- 
valued integral kernels arise naturally in this context. 

It is a well-known fact that for a given measure space (X, p) the Hilbert- 
Schmidt operators on L 2 (X) can be conveniently identified with integral ker- 
nels in L 2 (X x X, p (g> p). In this section we discuss the extension of this 
observation to vector-valued L 2 -spaces, mostly with the aim of computing a 
trace formula. Abstract computation -ignoring possible unpleasant linearity- 
vs.-sesquilinearity issues- allows to figure out what to expect: 

B 2 ( L 2 (X; 7-t)) ~ (L 2 (X) <g> H) ® (L 2 (X) <g> H) ~ L 2 (X x X) ® B 2 {H) 

~L 2 {X x X;B 2 {H)) ; 

hence replacing the scalar-valued kernels by Hilbert-Schmidt-valued ones 
should do the trick. 

In this section we give a proof of this correspondence, and then give a trace 
formula which is our chief motivation for using operator-valued kernels. For 
the proof of the trace formula Bochner integration is a useful tool. Following 
[117], we call a function / : X — > B, where X is a measure space and B a 
Banach space, strongly measurable if it is the pointwise limit (in the norm) 
of measurable finite- valued functions X — > B. Here measurability for finite- 
valued functions simply means that all preimages are measurable. For sepa- 
rable Banach spaces, this turns out to be equivalent to weak measurability 
[117, V.4 Theorem], which is defined by the requirement that 4> 0 f '■ X — > C 
is measurable, for all <j> £ B*. For the cases under consideration, this mea- 
surability condition is straightforward to check and will not be addressed 
explicitly. By [117, V.5], it is possible to construct a Bochner integral as- 
signing every strongly measurable / such that x e- > ||/(a’)||s is integrable, 
a unique value f x f(x)d/u(x). The following lemma makes the identification 
B 2 (L 2 (X, dfi; Tt)) — L 2 (X x X,d/j,',B 2 (Ti.)) explicit. 

Lemma 3.46. Let X be a measure space, with measure p, and consider the 
mapping T : L 2 (X x X;B 2 (H)) — > B 2 (h 2 (H\Tt)), F i— > Tp given by 
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(T F )(g)(x)= [ F(x,£)g(S)d»{t) . (3.38) 

J H 

Here the right-hand side converges for every x £ H satisfying the condition 
F(x,-) £ L 2 (X, dp; 62(H)), as an 7 d-valued Bochner integral. T is a unitary 
map, fidfilling ( TV )* = T F », where F *(£,£') = (F (£',£))* . 

Proof. We compute 

[ \\F(x,Ogm\dd(0 < f ||F(z,0IUI<?(0ll^(0 

J X j H 

< J x \\F{x,ohm)\mo 

where the last inequality is due to Cauclry-Schwarz. Fubini’s theorem implies 
that F(x, •) £ L 2 (X, 62(H)) for almost all x. For these x we have thus proved 
convergence of the right hand side of (3.38), while 

f \\(T F g)(x)\\ 2 dp(x) < [ \\F(x,-)\\l\\g\\ldii(x) < ||F||||| 5 || 2 
J H J H 

entails ||Tp||oo < ll-^lb- Hence T Fn —> Tp in || • Hoc whenever F n — > F in 
L 2 (X xX; 62(H)). 

Next pick ONB’s (ei)j e / of H and (<Pj)jej oiL 2 (X, dp). Then (( i>iej)iei,jeJ 
is an ONB of L 2 (X,dp;H) by 3.6, and then ((tfikee) <8 (Vmen)) k,e,m,n is an 
ONB of 6 2 (L 2 (X,dp;H)). It is easily seen that the preimage under K of 
these operators is given by the operator-valued functions 

Pk^Pm 8 Cfc . (£, f ) I > t pk(f,)Pm(f, )&H 8 C-k ; 

but the latter are an ONB of L 2 (X x X, dp; 62(H)). 

An arbitrary F £ L 2 (X x X; 62(H)) can be expanded in this ONB. 
Then the partial sums are mapped under T to a convergent sequence in 
62(L 2 (X,dp;H)), while on the other hand, they converge to T F in || • Hoc. 
This shows T F £ 62(L 2 (X,dp;H)) and ||Tf||b 2 = ||F||2. The statement con- 
cerning adjoints is immediate. 

The next lemma studies how operator multiplication and taking traces 
relates to the integral kernels. Since the result is of a strictly auxiliary nature, 
we do not consider the problem in full generality. In particular, we restrict 
attention to the case where X = H, a locally compact group, and p = p F - 
Note that 6\ C 62 implies that each trace class operator on L 2 (H;H) 
also has a unique Hilbert-Schmidt kernel. In the case of multiplication, the 
behavior is as expected, i.e. , the formula for the kernel of T F o Tq turns out 
to be a continuous analogue of matrix multiplication. On the other hand, the 
first guess for a trace formula, 
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trace(T J 4) = / trace(H(£, £))d£ 

J H 

is clearly problematic: Unless H is discrete, the diagonal in H x H is a set 
of measure zero. Hence if the operator field (H(£, is just viewed 

as an element of L 2 (H x H; B 2 {H)), the formula does not even make sense. 
The following lemma shows however that the integral kernels of trace class 
operators can be chosen in such a way that not only the trace of Ta, but also 
the traces of related operators can be computed by integrating the traces on 
certain subsets A C H x H of product measure zero. 

Lemma 3.47. Let H be a locally compact group. Let F,G G L 2 (HxH, 
and define 

A(£,e)= [ F{Z,?)G{?,S")d? (3.39) 

Jh 

whenever F(£, •), G(-, £") G L 2 (H, H 2 ( 74)) 

(a) The set {(£, £") : F(£, •), G(-, £") G L 2 (i7, 7?2(74))} C H x H has a comple- 
ment of measure zero. On this set the right hand side of (3.39) converges 
as a B\(TL) -valued Bochner integral. In particular, A(£,£) is well-defined 
for almost every £ G H . 

(b) A as defined in (3.39) fulfills A G L 2 (H x H\ B^ifHf) and Ta = Tp o Tq- 

(c) Let A be given by (3.39). Let 7 G H, and « measurable field of 

unitary operators on TL. Then the operator kernel 

B : ~ A&'y-YWe' 

is in L 2 (H x H,B 2 (Tt)), with Tp trace class. The trace is computed as 

trace (Tp ) = j trace (H(£, 7 _1 C)Uj) d( . (3.40) 

Jh 

We moreover obtain the inequality 

[ ||^,7" 1 0^llide<ll^ll2||G||2 (3.41) 

Jh 

Proof. Clearly, F(£, £')G(£', £") G Si (74). Now the calculation 

<n^-)ii 2iiG(-,nii2 

establishes the convergence statement of (a). That the sets on which this 
convergence holds are conull (both in H x H and on the diagonal) follows 
from Fubini’s Theorem. 

For part (b) we observe that Bochner convergence of (3.39) in Si (74) entails 
Bochner convergence in S 2 (74), hence 
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[ [ P(£,mi !«'< 

JH J H 

-JhL ( L l|F ^ll 2 ll G ^’^ll 2 ^') d ^" 

< JhJh (/ ff Il^,*)ll2d®) (/ ff l|G(y,nil2^) <*<%' 

= \\F\\l\\G\\l ■ 

Hence A £ L 2 (HxH, B 2 CH)), and Ta = T f oTg is verified by a straightforward 
calculation. 

For the proof of part (c) we first observe that 

BO£,n= [ F&om'iOda' , 

JH 

where 

K:HxH5 (£',£") ~ G(?, ■ 

Leftinvariance of the measure and the fact that the U^' are unitary ensure 
that K £ L 2 (H x H 1 B 2 {H)). Now the same argument as for (a) yields that 

b(z,o= \ , ( 3 . 42 ) 

JH 

with Bochner convergence in B\(H) whenever ||F(£, •) || 2 , ||G(-, 7 _1 £)||2 < oo, 
i.e., for almost every £. More precisely, we obtain for these £ that 

||-B(£,0||i < ll-F 1 (^-)||2||O(-,7“ 1 0||2 ■ 

Integration over £ yields 

JjB(£,0\\idt;< (/ Il^-)ll^) / (/ l|O(-,7 _1 0lli^) ' =II^I|2||G|| 2 , 
i.e., (3.41). 

For the proof of (3.40), observe that F e- > T F is unitary. Then the definition 
of the scalar product on L 2 (H x H, S 2 (?f)) entails 

trace(T B ) = trace(Tp o T K ) = (T F ,T^) = (T F ,T K *) 

= [[ trac e(F(Z,?)((K*)(Z,e))*)dlid£ 

JH JH 

= [ [ trace (F&OGtf^QUt) d?d£ , (3.43) 

JH JH 

where we used the definition of the adjoint kernel K* in the previous lemma 
to compute 
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Now the Bochner convergence of (3.42) together with the fact that the trace 
is a continuous functional on B\{ht) allow to pull the trace out of the inner 
integral of (3.43), by [117, V.5, Corollary 2], thus leaving us with the desired 
relation. 



3.8 The Plancherel Formula for Nonunimodular Groups 

In this section we give an outline of the construction of the Plancherel trans- 
form of a nonunimodular type I group, as it was derived by Duflo and Moore 
[38, Paragraph 6[. Similar results were obtained by Tatsuuma [110], as well as 
Kleppner and Lipsman [75]. 



3.8.1 The Plancherel Theorem 



The following theorem summarizes both the unimodular and the nonunimod- 
ular cases. 



Theorem 3.48. Let G be a locally compact group. Assume that G and N = 
Ker(Z\c) are type I groups, with N regularly embedded. Then there exist 

• a Plancherel measure v G on G, 

• a measurable field (C^^g of densely defined selfadjoint positive operators 
with densely defined inverses, 



such that the following statements hold: 

(a) For all f € L 1 (G) fl L 2 (G) and the closure of the operator ct(/)G“ 1 is in 



@ 2 ('Ha-), and 



ll/lll = LlMDC-^wlducia) . 

JG 

(b) T extends uniquely to a unitary operator 



(3.44) 



V : L 2 (G) - = r B 2 (H a ) du G (a) , 

JG 

the Plancherel transform of G. 

V implements the following unitary equivalences 


(3.45) 




/*© 

' (7 0 1 dvdo') 

G 


(3.46) 




r® 

f 1 0 (7 dv G {or) 
G 


(3.47) 


VN t (G) ~ j 


f B(7i a ) 0 1 dv G [a) 

G 


(3.48) 


VN r (G) ~ j 


f 1 0 B(H a ) dn G (a) 

G 


(3.49) 
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(d) v G and the operator field (C (T ) (Tg g can be chosen to satisfy the inversion 
formula 

/( x) = [ trac e([a(f)C~ 2 }a(x)*) dv G (a) , (3.50) 

Jg 

for all f in a suitable dense V C L 2 (G). The inversion formula converges 
absolutely in the sense that v G -almost. every a(f)C~ 2 extends to a trace- 
class operator, and the integral over the trace-class norms is finite. 

(e) The pair {vq, ( C (7 ) (jG q is essentially unique: The semi-invariance rela- 
tion 

a{x)C cr a{x)* = A g {x) 1/2 C !J (3.51) 

fixes each C a uniquely up to multiplication by a scalar, and once these are 
fixed, so is v G . Conversely, one can fix v G ( which is a priori only unique 
up to equivalence) and thereby determine the C a uniquely. 

(f) G is unimodular if and only if for v G -almost. all a, C a is a multiple of the 
identity Id on TL a . In this case the requirement C a = Id-^, yields that 
v G is the canonical Plancherel measure. 

If G is nonunimodidar, C a is an unbounded operator for (v G -almost all) 
cj&G. 



Let us clarify the relation between the normalizations of v G and the C a : 

Assume that vg, (C a ) also fulfill the properties of the theorem. In par- 
V J aeG 



ticular, since (3.44) holds with v G and C a in the place of u G and C c ,, 
deduces 






/ dv G 



\ dv G 



0 ) 



- 1/2 



a 



one 



Let us repeat the observation, already made in Section 2.4 for the discrete 
series case, that if the group is nonunimodular, relation (3.51) necessarily 
entails that C a is unbounded. 



Remark 3.f9. The inversion formula (3.50) generalizes (3.28). It was shown in 
[38] to hold for the space of Bruhat functions V introduced in [26] . This space 
is defined as 



V(G) = [J{G(? 0 (G/A') : K C G compact such that G/K is a Lie group } , 



where C)f ) (G/K) is the space of arbitrarily smooth functions on G/K with 
compact support, canonically embedded into G C (G). Theorem 4.15 below con- 
tains an extension of this formula to the natural maximal domain of this for- 
mula, which will turn out to be crucial for establishing admissibility criteria. 

We adopt the notations fixed in Remark 3.32 for unimodular groups for the 
general case. In particular, the distinction between the Fourier and Plancherel 
transform, and the fact that we reserve the notation^ for the latter, becomes all 
the more important due to the fact that the two now differ even for functions 
inL 1 (G)nL 2 (G). 
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3.8.2 Construction Details* 

The results presented in this subsection are indispensable for our purposes, 
as they provide concrete realizations of the representations entering the 
Plancherel formula, along with a detailed description of the Duflo-Moore op- 
erators and their domains. Both are needed to prove the results in Chapter 
4. 

We already remarked that the key technique for the construction of the 
Plancherel measure of a nonunimodular group G is to apply Theorem 3.40 to 
the group extension 

l-> N ^ G ^ H , 

where N = Ker(Z\( 3 ) and H = G/N. This approach provides in particular 
an explicit description of the Duflo-Moore operators, which will be crucial for 
the construction of admissible vectors. While the measure-theoretic details are 
somewhat tedious, there is a quite intuitive scheme behind these results, based 
on the double role of the factor group H: On the one hand the identification, 
via cosets, of G = N x H gives rise to a measure decomposition of pc in 
terms of /zjv, p h and Aq- On the other hand, it turns out that the operation 
of H on N is free i/jv-almost everywhere, giving rise to a Borel isomorphism 
N = V x H . Now V can be suitably identified with a subset of G, via the 
induction map, and the measure decomposition of i/jv along V and H provides 
a measure of V, which turns out to be the Plancherel measure of G. The 
connection between the various objects will be provided by the operator- 
valued kernel calculus. 

The following proposition spells out the measure-theoretic technicalities. 
We will not provide a full proof that the construction actually yields the 
Plancherel measure, however we will show that the transform constructed 
from the C a and vq is indeed an isometry L 1 (G) IT L 2 (G) — > B® . The direct 
computation showing this provides a nice illustration of the interplay between 
the measure decompositions on G and N. 

Proposition 3.50. Let G be nonunimodular and type I, with N = Ker(Z\( 3 ) 
type I and regularly embedded. Then there exists an H -invariant Borel subset 
U C N with the following properties: 

(i) vn{N \U) =0. The quotient space U/H is a standard Borel space. 

(ii) For every a £ U , Ind^cr € G. Moreover, H operates freely on the orbit 
O(a). 

(in) The mapping ( 0(g )) i— > Ind^p is a Borel isomorphism U/H — > V = 
Ind(/7), where V is a standard Borel subset of G. Moreover, there exists 
a Borel cross section r : V — > U, such that H x V 9 ( H , a) i— > Hr (a ) € U 
is a Borel isomorphism. In particular, both U and t(V) are standard. 

(iv) Let the function if : U — >■ R + be defined by pulling the mapping H x V 9 
( 7 ,<t) 1 — ► Ag(H)- 1 / 2 back to U via r. Then if is measurable. 
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(v) Plancherel measure on V = U/H is obtained by a measure disintegration 
along H-orbits: If each orbit 0 (t(<j)) is endowed with the image Ho( T {o)) 
of Haar measure under the (bijective) projection map H 9 7 1— > 7.r(cr), 
there exists a unique measure vq on V such that 

dv N {o) = ip(Q)~ 2 dp, O ( T ( a ))(0)dn G (cT) ; (3.52) 

the measure vq thus obtained is the Plancherel measure of G. 

(vi) If vq is constructed as in (v), and a = Ind^r(cr) £ U is realised on 
L 2 ( y H 1 dpH\'hL T (cr)) Ha cross sections, then C a is given by multiplication 
with Aq 1 / 2 : 

(C a i 7 ) ( 7 ) = ^g(7) _1/ V7) , 

and dom(C l cr ) is the set of all rj £ L 2 (H, dpr',0 T (o)) f or which this product 
is also in L 2 (H,dfir','H T (cr))- 

Proof. Part (i) is given by [38, Theorem 6, 1., 2.], using in addition that A<y 
is type I. The choice of U also guarantees Ind(f7) C G, [38, Lemma 8] which 
is the first statement of (ii). The second statement of (ii) then follows by [38, 
Lemma 7]. That Ind induces a Borel isomorphism U / H — » V is due to [38, 
Lemma 13], possibly after passing to a smaller set U' C U while preserving 
all other properties. The existence of a Borel cross section and the resulting 
Borel isomorphism are observed in the proof of [38, Proposition 10]; again we 
might have to pass to a i^v-negligibly smaller set. In particular, both U and 
t(V) are standard, as Borel-isomorphic images of standard Borel spaces. Part 
(iv) is obvious. Parts (v) and (vi) are [38, Theorem 6, 3.]. 

A pleasant consequence of part (ii) is that the Mackey obstructions for all 
cto € U are particularly trivial in the sense of 3.38. 

Corollary 3.51. If Xg is type I and G is nonunimodular, then Xq — 00 ■ X a- 

Proof. Since R + has no nontrivial noncompact subgroups, H is infinite. Hence 
Ha = L 2 (H,dpH',H T (a)) is infinite-dimensional. Accordingly, the left opera- 
tion of a on B 2 (l~to) has infinite multiplicity, for almost every a £ G. Since 
A g is the direct integral of these representations, the analogous statement for 
A g follows. 

In the following computations we refer to an explicit construction of the 
direct integral space £>®. This amounts to making several concrete choices. 

• We pick a fixed measurable r : V — > N and let Uq = r(V). 

• We fix a measurable realization of Uq, which exists by [88, Theorem 10.2], 
and since Uq is standard. 

• For 7 £ H and cto £ Uq, we realize 7.0-0 on H ao by (7.00) (2) = 
cr o(o(7)' 1 a;a(7)). 

• The induced representations Ind^oo are realized on H a = L 2 (H, dp.n\ H ao ) 
using the cross-section a; see Proposition 3.36 for construction details. 
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• The measurable structure on the TL G is defined as follows: Given a measur- 
able family of ONB’s (e™ 0 )aeu 0 , of the ' H ao , and given an ONB (a„) n6 N of 
L 2 (H), (a n e%) n ,k is an ONB of H a = L 2 (H,dgH','H T (a)) ~ TLa 0 ® L 2 (77), 
except for the zero vectors belonging to the indices k > dim(7 f T ( CT )), 
and it is straightforward to check that it is a measurable structure on 
(Ha)aeu- Moreover, it is easy to construct a measurable family of ONB’s 
from this: First note that the sets Ve := {a : dim (7f T ( CT )) = £}, for 
<eNU {oo}, are Borel sets [88, Theorem 8.7]. On each Ve, pick a fixed 
bijection se : N x {1, ...,£} — > N (where {1, . . . , oo} := N). Then letting 
u< s e (n k) ;= a « e fc 5 f° r a ^ removes the zero vectors from our measur- 
able structure {a n e^)ceu- Moreover, on each Ve, the measurability is easily 
checked, and this is sufficient. 

• We make the identification 

H x Uq = U via H x Uo B ( 7 , 00 ) 1 — > 7.00 • ( 3 . 53 ) 

In this parametrization, 



^((7 Wo)) = ^ g 1 / 2 ( 7 ) 

and 

du N ("/,a 0 ) = A G ('y)dvc(o-)dnH('y) , ( 3 . 54 ) 

where a and a 0 are related by cto = r(<r). 

The following lemma computes the Haar measure of G in terms of hn and 
/in, and fixes the normalization we use in the following. 

Lemma 3.52. Fix a measurable cross-section a : H — > G. Then the mapping 
N x H B (go,"/) 1 — > goot("f) £ G is a Borel isomorphism. We use the notation 
g = goa(l) = (go,"/)- Then 

dHG(go,l) = dpN(go)A G ("f)dn H ("f) ( 3 . 55 ) 

is a left Haar measure. 

Proof. Fix g = g 0 a(j),g' = g' 0 a(Y) G G, then 

gg’ = g a(i)g' a("/)~ l a("/)a("/)' a^Y ) -1 a(lY) 

with a(7)5Qa(7) _1 , a(7)a(7) / a(77 , ) _1 G N (observing N <\G). Hence right 
translation on G corresponds to right translation in the variables go,"/, though 
not by g'o,Y ■ Now the rightinvariance of pn,Ph entails that dpN(go)d/iH("/) 
is a right Haar measure on G. But then Aad/iNd/iH is a left Haar measure. 

In order to check the Parseval equality of the Plancherel transform con- 
structed from the C a and vq as in the proposition, we need a few technical 
lemmas. The first one computes the action of Ind^(uo), for a 0 G U. 
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Lemma 3.53. Let <To £ Uq and a = Ind^oo- Define the cocycle A : H x H — > 
N by 

yl(7,0 = a(0 _la (7)a(Q!(7) _1 0 . 

If we realize a on L 2 (if, dpy, TL a ) via the cross-section a, we obtain for x = 

00)/) (0 = (<ToC)(gi)cr 0 (2l(7,0)/(7^ 1 C) • (3-56) 

Proof. Since the measure is invariant, formula (3.29) for induction via cross- 
sections yields 

O0o,7)/) o) = /oorooo 

= CT 0 (a(0”0o00^(7,0) /0 _1 0 

= 0-cto)Oo)cto(21(70))/(7 _1 0 , 

where a/y) -1 ^,/ 1 ^ = ct/y)" 1 / is due to N < G . 

The next step consists in showing how the integrated representation 
Ind'/cro acts via an operator-valued integral kernel, thus bringing the tech- 
niques from Section 3.7 into play. 

Lemma 3.54. Let ao € Uq and a = Ind^oo- For g £ L 1 (G) let g 7 := g(-, 7 ). 
Then a(g) : L 2 (iT, dpn ; TL ao ) — » L 2 (7T, dpn] FL ao ) can be written as 

ct ( s )/(0 = [ H€n)f{'y)d'y , 

J H 

where k is an operator valued integral kernel given by 

*(£>7 ) = 0-cto)0 7 -^) °ctoO(7"0,0) • ^g( 7"0) ■ 

Proof. First note that by Fubini’s theorem g 1 £ L 1 (N), for almost every 7 £ 
H , which justifies the use of (£.cto)(< 7 7 -ic). The following formal calculations 
can be made rigorous by plugging them into scalar products, according to the 
definition of the weak operator integral. Using the previous lemma, we see 
that 

(ct(s)/)( 0 = / / 5(ffi,7)(/CT 0 )(5i)CTo(^(7,/))/(7^ 1 /)^i^G(7)^7 

J H JN 

= ^(/•CTo)(s 7 )cto( 71(7, 0)/(7 _1 £) A?(7)dy 

= / (/•CTo)(ff 7 -i)CT 0 (^l(7 _1 ,/))/(70 zi G(7^ 1 )rf7 
J H 

= [ (/•CT 0 )(ff 7 -i5)CT 0 (2l(7 _1 /,/))Z\G(7^ 1 /)/(7)rf7 j 
J H 



which is the desired formula. 
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Now we can prove that on L 1 (G) IT L 2 (G) the Plancherel transform pre- 
serves the L 2 -norm. Recall that the operator a(g)C ~ 1 has the operator kernel 



°o- 0 (yl(7 1 C,6 )- zi G (7 1 0 '^g( 7) 1/2 , 



and therefore 



Jja^C^Wldvda) 




[ (^o _ o)(5 7 - 1 c) cr o(^(7 1 ^C))^g(7 1 ?)^g(7) 1/2 

JH 2 

d-yduaicr) 

= [ [ f (7C-o’o)(^)^G(?) zi G(7) 1/2 d£,d'idv G {a) 

JUJHJH 2 

= JhUuJh ^' <To ^ 9 ^ Ag ^ Ag ^~ 1>)1/2 2 dl dv o {^ d £, 

= J H (yj v j R \\{l -Vo){9d\\l A G{l)dldv G {a^ A g( 0 ^ 

= (^j Q \\e(gi)\\ 2 2 dv N (Q)j A G (£)d£ 



(3.57) 

(3.58) 

(3.59) 



= [ \\ 9( :\\ lAaiOdt (3.60) 

JH 

= llfflll • (3.61) 



Here the various equalities are justified as follows: (3.57) is obtained by drop- 
ping the unitary operators cro(^(7 _1 ^ £))> and a change of variables. (3.58) is 
Fubini’s theorem, and again a change of variables. In line (3.59) we used the 
measure decomposition (3.54) of vq. (3.60) is an application of the Plancherel 
formula for N, while the last equality uses the measure decomposition (3.55). 





4 



Plancherel Inversion and Wavelet Transforms 



This chapter fully exhibits the relationship between the continuous wavelet 
transforms discussed in Chapter 2 with the Plancherel formula. A first instance 
of the connection was discernible in Remark 3.34 dealing with discrete series 
representations of unimodular groups: Computing the constant governing 
the admissibility condition for such representations 7r was found to be equiv- 
alent to computing the Plancherel measure of the set { 7r} , and the wavelet 
transform was found to be a particular case of inverse Plancherel transform. 

These observations are systematically expanded in the course of this chap- 
ter. We thus start out by discussing Fourier inversion, first as a mapping 
between a direct integral space Bf of trace class operators and the Fourier 
Algebra A(G). We then prove a Plancherel inversion formula (Theorem 4.15), 
from which the L-convolution Theorem 4.18 follows immediately. The same 
argument as for the toy example then yields admissibility conditions from 
the convolution theorem (Theorem 4.20). We characterize when admissible 
vectors exist (Theorem 4.22). Remark 4.30 offers a strategy for the solution 
of T4, sketching a systematic approach to treat arbitrary representations via 
direct integral theory. In the unimodular case it can actually be shown that 
the scheme from 4.30 characterizes the canonical Plancherel measure. We also 
discuss briefly how the scheme relates to the type I assumption. The final sec- 
tion of the chapter is devoted to a short diversion treating Wigner functions 
associated to nilpotent Lie groups. 

The standing assumptions throughout this chapter are: G and N = 
Ker(Z\< 3 ) are type I, with N regularly embedded. 



4.1 Fourier Inversion and the Fourier Algebra* 

The natural domain for Fourier and Plancherel inversion formulae is given by 
the Fourier algebra A(G) and its counterpart Bf on the Fourier side. In order 
to motivate the latter space, recall the situation over the reals: Formally, the 
inverse Plancherel transform of / £ L 2 (R) is given as 



H. Fiihr: LNM 1863, pp. 105-138, 2005. 
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f(x) = f f(w)e 2wixu du) , 

Jr 

and it is a well-known fact in Fourier analysis that this equation holds 
rigourously pointwise almost everywhere whenever / £ L 1 (K), which is the 
natural condition to ensure absolute convergence of the integral. The analo- 
gous formula for general locally compact groups will be 

a(x ) = / trace(A a cr(x)*)di'G(cr) . (4.1) 

Jg 

The operator fields A for which this formula makes sense constitute the Ba- 
nach space £>* defined in the next lemma. Its proof is standard and therefore 
omitted. 

Lemma 4.1. Let Bf be the space of measurable fields (B(a)) a£ Q of trace 
class operators, for which the norm 

II^IIb® : = L ll s ( CT )lli dv G (<r) 

J G 

is finite. Here we identify operator fields which agree vc-almost everywhere. 
Then (Bf, ||-||g®) is a Banach space. 

Let us next define the space of functions arising as left-hand sides of (4.1, 
which is the Fourier algebra. 

Definition 4.2. The Fourier algebra of G is defined as 

A(G) := L 2 (G) * L 2 (G)* = {/ * g* : ,f,g£ L 2 (G)} . 

Endowed with the norm 

IMU(g) = ™f{\\fh\\gh -.u = f* g *} 

A(G) becomes a Banach space of Co-functions, with ||u|| J 4 (g) > Hujloo. A(G) is 
closed with respect to pointwise multiplication and conjugation, which makes 
^4(G) a Banach-*-algebra. 

Remark f.3. (a) By definition, A(G) is just the space of coefficient functions 
for A g and its subrepresentations. Hence it seems a natural object of study 
in connection with continuous wavelet transforms. However, neither the norm 
on A(G ) nor its algebra structure seem to be related in a canonical way to 
questions concerning admissible vectors and wavelet transforms. Hence the 
usefulness of A(G) in this connection is dubious. For our purposes, focussing 
on the Plancherel transform and its inversion, the benefit of considering A(G) 
mainly lies in clarifying the role of the von Neumann algebra VNi(G) in con- 
nection with inversion formulae, and in the notion of positivity which will be 
useful for convergence issues. 
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(b) Note that 4.2 is not the initial definition of A(G) given in [41], but equiva- 
lent to the original definition because of [41, Tlreoreme, p. 218]. Likewise, the 
norm given here is not the original definition in [41], but it coincides with it 
by [41, Lemme 2.14]. 

(c) If u € A(G), so are u*,u and u, the latter defined as u(x ) = u(a: _1 ); see 
[41, Proposition 3.8]. Moreover, we have 



||«*IU(G) = IMU(G) = INU(G) ■ 

The following theorem was given in [81] for unimodular groups. 
Theorem 4.4. Let A = (A a ) ae Q £ B® . Then 

a(x ) = T^ G ){A)(x) = trace(A< 7 a(x)*)di'G{cr) 

J G 

defines a function a € A(G). It satisfies the Parseval equality 

f f{x)a{x)dx = f trace(cr(/)A* )dis G (cr) , 

Jg Jg 

for all f £ L 1 (G). The linear operator A(G) is onto. 



(4.2) 



Proof. Let A a = U a \A a \ be the polar decomposition of A„. Then = 
U ( ,\A ( ,\fl‘ 1 and B 2i<t = \A a \f!' 1 defines elements Bi,B 2 £ B ®, since 



ills® = tTace(B U(T Bl j(T )duG{cr) 

= f trace{U*U a \A a \)dvG{(j) 

Jg 



= II^IIb® > 

and similarly ||i? 2 ||g® = ||A|| B ®. For measurability confer Lemma 3.7. Denot- 
ing by bi,b 2 £ L 2 (G) the respective preimages under the Plancherel transform, 
we find 

a(x) = / trace(A a a(x)*)di'G(<7) 

Jg 

= / trace{Bi^B 2 ^(j{x)*)dvG{a) 

Jg 

= {bi,\a{x)b 2 ) 

= (h*b* 2 ){x) , 



hence a £ A(G). If, conversely, a = b± * b 2 £ A{G ), define (£? ij0 .) g = bi. If 
we then let A a = Bi tlJ B 2 a , the same calculation shows that a = Tf lc ^{A). 
Hence the mapping is onto. 
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Finally, let us show the Parseval equality. Let A a = Bi^B 2 ^ a as above, and 
denote by hi, h 2 the inverse Plancherel transform of (£?2 !(7 ) g and (£?i iCT ) g, 
respectively. It follows that 



trace(<r(/)A*)di/ G (a) = / trace(cr( f ) B 2 a Bl a )dv G (<j) 

• J& 

= / trace ((/*/ii) A (cr)5i , T )fi^ G (cr) 



= / (/ * hi)(x)h 2 {x)dx 



I f{y) J hi(y 1 x)h 2 {x)dxdy 



I f{y) J h 2 (x)hi(y x x)dx dy 



j f(v) y^ tr ace(Bi, (T B* i2 CT( 2 /)*)(i^ G (cr) dy 



= / f(y)a(y)dy . 



Remark 4-5. Below we will show that the Fourier inversion formula maps Bf 
isometrically onto A(G). Now we are faced with the somewhat puzzling situa- 
tion that on the one hand, Plancherel measure - which defines the norm on Bf 
- is not uniquely given, whereas the norm on A(G) is defined independently 
of a choice of Plancherel measure. 

This apparent contradiction is easily resolved: Suppose that and u 2 are 
two different choices of Plancherel measure. Denote the corresponding spaces 
of integrable trace class fields by Bf (i/j). Then there exists a canonical isomet- 
ric isomorphism T : Bf{v 1 ) — > B®(v 2 ), given by pointwise multiplication with 
Moreover, if we denote the corresponding Fourier inversion operators by 

T~ x : B?( Vi ) - A(G) , 

an easy computation establishes that T 2 X = o T. 

It is similarly remarkable that the Duflo-Moore operators do not make a 
single appearance in this section. 



A most useful feature of A(G) is its close relationship to the left von 
Neumann algebra VNi(G), as witnessed by the next theorem [41, Theoreme 
3.10]: 

Theorem 4.6. Let A(G)' denote the Banach space dual of A{G). For all T £ 
VNi(G), there exists a unique linear functional ipT G A(G)' such that, 



M(f*9l v ) = (Tf,g) ■ 
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Here V denotes the involution from Remark 4-3(c). The mapping T i— > ip T 
is an isometric isomorphism VNi(G) — > A(G)' , which is bicontinuous if 
VNi(G) is equipped with the ultra-weak topology and A(G)' with the weak* - 
topology a(A(G )' , A(G)). Conversely, the ultra-weakly continuous linear forms 
on VNi(G) are precisely given by the mappings T i— > c Pt{u ), for fixed 
u £ A(G). 

Definition 4.7. The predual property of A(G) allows to lift, the action of 
VNi(G) on itself to an action on A(G), via duality [41, 3.16]. More precisely, 
for T £ VNi(G), let.T i— > T denote the adjoint of the involution a i— > a. Given 
u £ A(G), the functional 



VNi(G) 9 S e- > ipf s (u) 

is ultraweakly continuous, hence corresponds to a unique element Tu £ A(G). 

For u £ A(G) n L 2 (G) and T £ VNi(G) the notation Tu is ambiguous, but 
[41, Proposition 3.17] notes that the two possible meanings coincide, and that 
u e- > Tu is in fact norm-continuous on A(G). Hence an alternative way of 
defining the mapping u i— > Tu could proceed by extending it by continuity 
from A(G) fl L 2 (G), which by [41, Proposition 3.4] is dense in A(G). 

Positivity, as defined next, will be useful in connection with convergence 
issues. 

Definition 4.8. A function u on G is called of positive type if for all n £ N 
and all x\, . . . , x n £ G the matrix is positive semi-definite. 

In such a case we write u 0. If u±,U 2 ^ 0 with u i — «2 ^ 0, we write 

Ul » « 2 - 

Remark 4-9. u^> 0 implies u{x) = u(a: _1 ), i.e. u = u*. Moreover, it is obvious 
that u 0 iff u » 0. Particular examples of functions of positive type are 

x (7t(x)£,£) , x i— > (f, n(x)£) , 

where it is an arbitrary unitary representation, and f £ Tt n . For the first 
example, confer [35, 13.4.5], while the second is just the complex conjugate 
of the first. The first example is the typical way of referring to functions of 
positive type, while the second is more adapted to coefficient functions. 

Taking n = Ac, we find in particular for all / £ L 2 (G) that f * f* 0. 
Conversely, [57, p.73, Theoreme 17] states that for all u £ A(G) with u 0 
there exists / £ L 2 (G) such that u = f * f* . 

Next let us take a closer look at the duality between VNi(G) and A(G) on 
the Fourier side. For this purpose we need an invariance property of Plancherel 
measure under the taking contragredients. The result is probably folklore; it 
is mentioned for instance in [81, Section 3]. We have not been able to locate 
a proof, though. If it, a are two irreducible representations with tt ~ <r, we 
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use the unique unitary intertwining operator H n — > Ha to identify 7r with 
the standard realization of a. This needs to be kept in mind in the next two 
lemmas, where we do not explicitly distinguish between operators on Ha and 
operators on Hg-, even though for a given measurable realization of G the 
representative of [cf] will not necessarily be the standard realization of the 
representative of [cr\. 

Lemma 4.10. (a) If G is unimodular and vq is the canonical choice of 
Plancherel measure, then vq is invariant under the mapping cr >—> a. 

(b) If G is nonunimodular, and vq is constructed from the canonical Plancherel 
measure of Ker(Ao) according to Proposition 3.50, then uq is invariant 
under the mapping a i— > a. 

Proof. For part (a) we let F denote the measure given by v{A) = : cr £ 

A}). We first show that V is r^-absolutely continuous. For this purpose observe 
that Xq x qg — Jqct <g>adi'G{cr). Now the fact that taking contragredients 
commutes with taking direct integrals and tensor products shows that Ag — 
qg- On the other hand, Ag — Qg via the involution / i— > A G ' f*. Hence 
A g — Ag- Now n = Jq advai.®) is multiplicity-free and quasi-equivalent to 
Ag, while W = Jq adv(a) is multiplicity-free and quasi-equivalent to qg — Ag- 
Hence tt sa W, which by [35, 5.4.6] entails that n ~ W. But then uq and V are 
equivalent. 

In addition, we obtain that the unique unitary operators H a i— ► H-g in- 
tertwining the realization of a used in the Plancherel decomposition with the 
standard realization on Tt a , constitute a measurable field of operators (out- 
side a z'G-nullset); confer [36, Theorem 4, p.238]. Hence the identification of 
operators on Ha and Hg- can be obtained by a measurable field of operators. 
As a first consequence, we see that the operator 

(At) ct(E g l— >■ (Aaj ae Q , 

defined for all A £ Bf for which the right hand side is in £>®, is densely 
defined and closed: It factors into the unitary map 

(^^S (fT) ) ae e 

followed by the densely defined closed operator consisting in pointwise multi- 
plication with yS. 

Next we recall that the canonical choice of Plancherel measure entails for 
/ £ L 1 (G) tlL 2 (G) that f(a) — a(f). A simple computation establishes 

T (/)0) = a(f) = cr(f) =J(cr) ■ (4.3) 

Note that this entails in particular that V(L 1 (G) flL 2 (G)) C dom(T). Since 
taking conjugates of L 2 -functions and Hilbert-Sclrmidt operators are obviously 
isometric operations, we obtain that 
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(/W) ct£ G ^ 

V / o-eG 

is a unitary operator on S®, and T is a densely defined closed operator co- 
inciding with it on a dense subspace. Hence T is unitary itself. But then the 
multiplication operator arising from the Radon-Nikodym derivative is unitary 
also, which entails = 1. 

This proves the statement concerning unimodular G. The statement for 
nonunimodular groups follows from this, the fact that Induct ~ Ind^er [86, 
Theorem 5.1], and the construction of uq from a measure decomposition of 
r'Ker(ziG)’ as sketched in Section 3.8. 

Lemma 4.11. Let A £ Bf , and a = Tf^ G fA). Let T ~ ( T a g 1 ) aeG £ 
VNi(G). Then 

<p T {a) = [ trace(f CT Hl)fi^ G (cr) . (4.4) 

J& 

Proof. In view of 4.10 we may assume that the Plancherel measure is invariant 
under taking contragredients. Hence, if (4l cr ) 0 . e g £ Bf, then {AL) a q £ Bf 
as well. In particular, for fixed A the right hand side of (4.4) is ultraweakly 
continuous as a function of T. 

By Theorem 4.6, the mapping T i— > is ultraweakly continuous as 

well, hence it remains to check (4.4) for T = \g{x), x £ G (these operators 
span a dense subalgebra). But here we have by [41, 3.14 Remarque], that 



i Pr(a ) = a(x) 

= / trace(A a a(x)*)di'G{cr) 

Jg 

= / trac e(A w a(x)*)di'G{cr) 

Jd 

= / tra,ce(A?Lcr(x))di'G(x) 

Jg 

= / trace(a(x)AG)di'G(x) . 

Jg 



Here the penultimate equality used the relations cr(x)* = cr^xf and trace 
(ST*) = trace(S'*T). Since A g(x) — ( a(x ) g) 1 ) ae Q, we are done. 

Now we can establish the Fourier transform on A(G). For unimodular 
groups, the theorem is [81, Theorem 3.1], for nonunimodular groups it is new. 

Theorem 4.12. (a) tFf( G y as defined in Theorem 4-4, is one-to-one. The 
inverse operator 

T A{G ) : A(G) -> Bf 

is thus a bijection, in fact an isometry of Banach spaces. 
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(b) If T ~ (t„ 0 l') _ £ VNi(G) and a £ A(G), then 

F A(G)(Ta ) = (r a tF a(g) ( a )( <J )) 0 . e g ' 

fc,) Let a = ^aIg) (A) • Then 

a 0 •<=>■ A a > 0 (: v G — a.e .) 

Proof. Define a = tf^ G ^(A), and let A a = U a \A a \ denote the polar de- 
composition. Define Bi a and as in the proof of 4.4. We recall that 

II All b® = milg 1 ® , and ^(A) = b\ * b%. Then a = b\ * b% implies that 

ll/ll A(G) < ll&llbll^lh = Mils® • 

For the converse direction define T £ VNfG) as T CT = (t/jfj 0 1. Then the 
previous lemma entails 

ip T (a) = f trax:e(U w U^\A w \)du G (a) = ||A|| g ® . 

Jg 1 

But a i— > <p,(a) is an isometric embedding of A(G) into VNi(G)', by 4.6. 
In addition, ||T||oo < 1, being defined by a field of partial isometries. Hence 
II a|| j4(g) > ||A||g®, and ^a(G) shown to be isometric, in particular one-to- 
one. This closes the proof of (a). 

For the proof of ( b ) fix T £ VNi(G), and denote the corresponding operator 
field on the Plancherel transform side by ( T a 0 1) g. Consider the mappings 

1. a i— > Ta 

2 . a^T~l G) (^T a T A(G) (a){a)) 

on A(G). We claim that they coincide on the subspace C c (G)*C c (G ) C A(G), 
which is dense by [41, Proposition 3.4]. Indeed, let a = f*g* with f,g£ C c (G). 
The usual calculation shows that Ai(G)( a ) = (/( cr )ff( cr )*) cre g- 3 is a bounded 
vector by 2.19, i.e., V g £ VN r (G). Since VNi(G) and VN r (G) commute, 

[T(a)](x) = [T(V g f)](x) = [V g (T(f))](x) = [T(f) * g*}(. x) 

= J trace (T a f(a)g(a)*a(x)*^ dv G (a) , 

which shows the claim. Now mapping 1. is bounded with respect to || • ||a(G) 
by [41, Proposition 3.17]. On the other hand, since Pa(G) is isometric, we 
only need to show that ( T a 0 1) g acts as a bounded operator on Bf, which 
follows trivially from the boundedness of T . Hence we have shown (b) on all 
of A(G). 
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1 /2 

For (c) first assume A a > 0, ryj-almost everywhere. Then taking g a = AJ 
defines 'g £ Bf, and the calculation 

■ 7r A(G)( j4 )( a; ) = L trace(g <J g* a a(x)*)diy G (cr) =g* g*{x) 

J G 

shows that indeed T^ G ^{A) 0. Conversely, if a = T^ G ^{A) 0, then a = 

g * g*, and a similar calculation establishes that J r A(G){ a ) = (?( <J )g( cr )*) 0 . e G> 
which clearly is a field of positive operators. 

The following lemma will be instrumental in establishing the Plancherel 
inversion formula. 

Lemma 4.13. Let G be unimodular. Suppose that u\,u 2 £ L 2 (G) fl A(G), 
with u 2 u\ 0, and that u\ is a bounded vector. Then || 1 | 2 > ||wi|| 2 - 

Proof. It suffices to show that 

(ui,u 2 ) > ||ui||| , 



since this implies 

IMI! - lluilll > WMl + ll«l|ll - 2(«1,U2) = \\U2 - «l||l . 

By assumption, there exists ip € L 2 (G) such that u 2 — u\ = ip * ip. Pick 
(<Ai)neN C C c (G ) converging to 4’ in || • || 2 - Then 

\(lp,Ui * Ip) - (ip n ,Ui * (f n ) | < \{lp - Tn,Ui * Ip) | + |(y>„,Ul * {Vn ~ ^))| 

< || Ip - </3 n || 2 ||wi * 1p\\ 2 + || ^Pn || 2 ||^1 * (<Pn - VOII 2 - 

using the boundedness of u\. On the other hand, {ip n *g>* n , uf) > 0 by positivity 
of u\ ([35, 13.4.4], observe that for unimodular groups our involution coincides 
with the one in [35]). Hence 

(it 2 - Ml, ui) = lim {(fi n * <p* n , Ui) > 0 , 
n—> 00 

which finishes the proof. 



4.2 Plancherel Inversion* 

In this section we discuss the L 2 -functions which can be obtained by the 
Fourier inversion formula (4.1). Clearly these functions are precisely the in- 
tersection H(G)nL 2 (G). However, the description on the Plancherel transform 
side is much less obvious. In view of the last section, any theorem describing 
pointwise Plancherel inversion via (4.1) will contain some statement on the 
relationship between the spaces Bf and Bf and the operators V and T a(G)- 
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A first conjecture, which turns out to be correct for unimodular groups, could 
be that Pa(G) ma P s &2 ^ bijectively onto L 2 (G) D A(G). This statement 
implies in particular that Fa{G) an d P coincide on L 2 (G) ft A(G). 

In the nonunimodular case however, this cannot be expected. Using the 
next lemma, it is possible to compute at least for V g f, f G L 2 (G),g G C c (G), 
what the image under Plancherel transform is: 

C V gf ) a (ct) = f(a)a(A~ 1/2 g*) = [f(a)g(a)*C a } . 

Recalling that operator fields of the form (/(o’)g(cr)) g are typical elements 
of 6®, this calculation motivates the conjecture that L 2 (G) fl A(G) is the 
image under F~a{G) ^he s P ace 

{(A a ) aed G Bf : (KCy^g G B®} . 

Theorem 4.15 below proves this conjecture. But first a few basic computations 
concerning the interplay between convolution with functions in C c {G) and the 
Duflo-Moore operators. Not all of them are needed, but we include them for 
completeness. 

Lemma 4.14. Let f G C c {G). 

(i) For vc-almost every a, we have f{cr)* = G“ 1 (j(Z\q 1 /*). In particular the 
right hand side is everywhere defined and hounded. 

(ii) For UQ-almost every a, we have 

H/jC” 1 ] = C- l o(A- G 1/2 f) , 

in particular the right hand side is everywhere defined and bounded. 

(Hi) For all g G L 2 (G), we have 

1 9 * f){v) = g(a)a(A~ 1/2 f) , 

(/*5)(c) = cr(/) • 

(iv) For all g G L 2 (G), we have 

{A-^g*r{a)=g{ay . 

Proof. For part (i) we invoke [104, Theorem 13.2], to find that, since G” 1 
is selfadjoint and a (/) is bounded, (a(f)C~ 1 )* = G” 1 cr(/)*. Moreover, since 
/(<j) is bounded, the right hand side of the last equation is everywhere defined. 
We conclude the proof of (i) by computing 



(v(Ag f *)<!>, v) = [ {A G 1 {x)f(x~ 1 )a(x)cj>, rj)dx 
JG 

= [ f(x~ 1 )v(x~ 1 )7i)A G {xy 1 dx 

J G 

= / {4‘,f(x)a(x)r])dx 
JG 



= (<M(/)t7) • 
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i /q 

For (ii) we first note that by (?), applied to A G ' f G C c (G), the right 
hand side is bounded and everywhere defined. Moreover, the left-hand side is 
bounded since / G L 1 (G) fl L 2 (G). It thus remains to show that the equality 
holds on the dense subspace dom(G“ 1 ): For </>,?? G dom(G“ 1 ) the definition 
of the weak operator integral yields 



(0) cr (/)C'<7 1? ?) = / <0, cr (x)C (7 1 r])f(x)dg G (x) 

Jg 

= [ {(j),A G {x)~ l/2 C~ 1 a{x)ri)f{x)dii G {x) 

= f {C~ 1 (j>,a(x)r])A G (x)~ 1/2 f(x)dix G ( x) 

Jg 

= (C~ V, a(A G 1/2 f)rf) 

= (^G-V^q 172 /)??} , 

where the second equality uses the semi-invariance relation (3.51), and the 
selfadjointness of G” 1 was used on various occasions. This shows (ii). 

Part (in) is then immediate from (?) and (ii), at least for g G L 1 (G) fl 
L 2 (G). It extends by continuity to all of L 2 (G): The left-hand sides are con- 
tinuous operators, being convolution operators with / G C c (G) (see 2.19(b)), 
and the right hand sides are continuous because of inequality (3.19). 

For part (iv), we first observe that both sides of the equation are unitary 
mappings, hence it is enough to check the equality on G C (G). Here (?) and 
(ii) give g(a)* = C~ 1 a(A G 1 g*) = o(A~ G /2 .g^G" 1 = (A~ G ' 2 g) A (a). 

The following theorem is one of the central new results of this book. For 
unimodular groups, it is stated in [81, Corollary 2.4, Corollary 2.5], though 
we will point out below that the argument in [81] seems to contain a gap. In 
any case, the nonunimodular part is new; one direction was proved in [4]. 

Theorem 4.15. Let (A a ) ae Q G Bf, and define 



a(x) = f trace(A a a(x)*)dv G (a) . (4-5) 

Jg 

Then a G L 2 (G) iff ([A a C a ]) a . e Q G B® ■ In that case we have ([H cr G cr ]) o . g g = a. 

Proof. First assume that ([A a Cc,]) a( - G G H®, and let b be the inverse image 
of that under the Plancherel transform. Then for any g G L 1 (G) flL 2 (G), 
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(g,b) = / trace(g(cr)[A CT C' CT ]*)(i^ G (cr) 

Jg 

= [tra,ce([a(g)C~ 1 ][A cr C cr }*)dvG(v) 



= / trace(cr(g) A* )dv G (cr) 



= / g(x)a(x)dx 



where the last equation is due to (4.2). Now Lemma 2.17 yields b = a almost 
everywhere, and thus a = ([A cr C' cr ]) (:rg g. 

Let us now show the converse direction. Assume that a £ L 2 (G). Let 
A a = U a \A a \ be the polar decomposition of A a , let U — (U a 0 1) g the 
element in VNi(G) corresponding to the partial isometries, and let 



h(x) = / trace(|A CT |(T(a;)*)c?^G(tj) . 

Jg 

By Theorem 4.12(b) we have that h = U*a, where the right hand side denotes 
the action oiVNi(G) on A{G). But a £ L 2 (G) then implies h £ L 2 (G), by [41, 
3.17]. Since (A cr ) crg g £ Bf iff (| A a \) ae Q £ B® , we may thus assume w.l.o.g. 
that A<j > 0. 

Now assume G to be unimodular. Pick an increasing sequence of Borel 
sets E n C G with || A a \\ 2 < n on E n , < oo and U„ e N = G (up to 

a Plancherel nullset). Consider the fields A n = (l Sn (a)A a ) ae Q £ B® ■ Then 
the direction proved first shows that 



a n {x) 



trac e(A"a(x)*)duG(cr) 



defines a sequence in L 2 (G), with d n = (A™) q. Observe that 



(a — a n )(x)= / trac e(A <7 a(x)*)di , G(o') , 

Jg\i 

whence Theorem 4.12 (c) yields a a n . Next we check that the a n are 
bounded vectors: By construction, ||A™|| 00 < ||A”|| 2 < n, hence for all / £ 
L 2 (G) 

v a n f{x) = f trac e(f(a)A^a*(x))di 2 G (< 2 ) 

Jg 

where {f(cr)A™) Q £ B® . Hence the previously established direction yields 
Va n f £ L 2 (G), i.e., a n is bounded. Now we may apply Lemma 4.13, implying 
|| || 2 < || a,|| 2 - But then ||A"|| B ® < ||a|| 2 , and thus A £ B® . 

Hence it remains to prove a £ L 2 (G) => ([A cr G cr ]) o . g g € B® for G nonuni- 
modular. In the following we use the notations from Subsection 3.8.2. Recall 
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in particular, that a = Ind^oo, and that A a is given by a Hilbert-Schmidt 
valued kernel (A CT (£, Again writing A a = F a G a , with F a ,G a G B ®, 

we appeal to 3.47 (a) and find that the integral kernel of A a is computed from 
the kernels of F „ , G„ by 

mm')= [ , 

J H 

whenever F a (£, •), G, (■,£") G L 2 (tf; B 2 (H a )) . 

Lemma 3.47 (a) states that the right hand side is a Bochner integral converging 
in Bf(H ao ). 

We next compute the integral kernel of A a a(g)*. Relation (3.56) implies 
for g = goa^) and uo = T (< J ) that <j(g)A * has the integral kernel 

(£>£') ^ (£-<ro)(ffo) °(r 0 (A(y,{)) . 



Transposing yields the kernel 

: (£>£') >->■ A ct (?, 7 _ 1 C') °< 7 0 (A( 7 ,£'))* o (£'.ct 0 )( 5 o)* 

for A a <r(g)*. 

By Fubini’s theorem, the mapping a(-, 7 ) : go e- > a(go,"f) is in L 2 (iV), for 
almost all 7 . We intend to apply the unimodular part of the theorem to these 
functions. Plugging in the kernel for A a tj{g)* and using the trace formula 
(3.40), we obtain 



a(5o,7) = 

= / tr&ce(A a (j(x)*) dvc{v) 

Jg 

= [ f trace (A CT (^7^ 1 ^)cr 0 (A(7,^))($ , .cro)(5o)*) rf^ G ((T) 

Jg J h 

= [ trace (A CT (^7^ 1 ^)cr 0 (A(7,^))Z\ G (^)" 1 cr( 3o )*) d^(^o-o) , (4.6) 
Jn 



where the last equation uses (3.54). Next we estimate 



/ 114(^7 1 C)oo(A(7,0)A g (C) 1 ||idi7v(£, ct 0 ) = 

JN 

= L [ II4 t(£> 7 -1 £)I|i d£,dv G (a) 

Jg J h 

< L\\FM\Gahdu G (x)<\\F\\ B e\\G\\ Bf , 

J G 

where the first inequality is due to (3.41), and the second is again Cauchy- 
Schwarz. Hence we see that 



o,0 = A CT (^,7- 1 Oa 0 (A(7,O)^ G (O - 1 (*o e[/ 0 ,(e H) 
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defines a measurable operator field D 7 £ Bf(N), and that (4.6) is Fourier 
inversion applied to this field. Now for every 7 with a(-,7) £ L 2 (IV) the 
unimodular part of the theorem implies that D 7 £ Bf(N), with 

IK-,7)ll2= L\\D^*0,m>N(*0,0 ■ 

Jn 

But then Fubini’s theorem and (3.55) imply 

N!= / ||a(- )7 )||^ G (7)d7 

J H 

= f f [ \\D' y (ao,Q\\lA G (£)d{di'G(<7o)AG('y)d'y 
J H JUo J H 

= f f f ll^<r(^7^ 1 C)< J o(^(7 1 C))ll2 Zi G(7^ 1 )^7^G(cr) 

J H Jg J h 

= f f f \\Aa(.Zil~ 1 0\\l A G{.lC 1 )dld£,dv G (.p) 

Jg J h Jh 

= f f f \\ A ^A)\\l A G{^ 1 )d')d£,dv G {o') 

Jg Jh Jh 

= f f [ \\ A <T{i,l) A G{lT 1/2 \\ld')didv G {(T) . 

Jg Jh Jh 

Hence we find in particular that for ryj-almost every a £ G the operator with 
kernel 

(£,7) ^ ^(£,7)^3 (7)- 1/2 

is Hilbert-Schmidt. On the other hand, recalling that C a acts via the multipli- 
cation with A G { 7) -1 / 2 , we see that A a C,j coincides with this Hilbert-Schmidt 
operator on dom(C' cr ). Hence [A a C a \ exists and is in ^(77^), and we conclude 

Nil = [ \\[AM\\ldu G {a) , 

Jg 

which finishes the proof. 

Remark ^.16. (a) The unimodular version of the Plancherel inversion theorem 
was shown in [81], and the proof of 

(Ka]) ae g e Bf => a £ L 2 (G) (4.7) 

immediately carries over to the general setting. Note that the argument relies 
on Lemma 2.17. 

This observation is crucial in connection with the proof for the converse di- 
rection 

a £ L 2 (G) =► (KC f ]) j£fi £ B ® . 

The argument given in [81] for unimodular groups uses (4.2) to establish 




4.3 Admissibility Criteria 119 



/ a(x)k(x)dx = / tr&ce(A (7 k(<j)*)di'G{o') , 

Jg JG 

for all k £ L 1 (G) nL 2 (G), and then concludes by density of P(L 1 (G) flL 2 (G)) 
in B® that a = A. This is the mirror image of the argument for ([A a C a ]) (7f -Q £ 
Bf =► a £ L 2 (G), with V(L 1 (G) n L 2 (G)) replacing L 1 (G) n L 2 (G). But in 
Remark 2.18 we saw that density alone is insufficient, and an analogue of 2.17 
for V(L 1 (G) flL 2 (G)) instead of L 1 (G) flL 2 (G) does not seem easily available. 

This is why the argument presented here is rather more complicated than 
the one given in [81]. Note in particular that we used the action of VNi(G) 
on A(G) and the notion of positivity from Section 4.1. A substantially shorter 
argument could be provided if the following rather intuitive result from inte- 
gration theory were true. Unfortunately I have not been able to prove it: 

Let a sequence (a„) n£ N C L 2 (G) be given with a n —> a uniformly. Suppose 
that the a n have orthogonal increments. Then a £ L 2 (G), with || a|| 2 > || a,n || 2 
for all n. 

Note however that this observation only allows to shorten the unimodular 
part of the proof. 

(b) The implication (4.7), with a much more complicated proof, may be found 
in [4]. This direction allows to prove sufficient admissibility conditions, as 
shown in [53]. For necessity of these conditions however, the converse of (4.7) 
seems indispensable. 



4.3 Admissibility Criteria 

In this section we solve T1 through T3 for the general setting, and discuss 
the qualitative uncertainty property. 

Since leftinvariant subspaces correspond to projections in VN r (G), we 
obtain an answer to T1 as an immediate consequence of the Theorem 3.48 
(c). 

Corollary 4.17. Let TL C L 2 (G) be a closed leftinvariant subspace. The pro- 
jection P onto TL corresponds to a field of projections P ~ (1 (g> P a ) a( -Q, i.e. 

(Pf) A (a) = f(a)oP a . (4.8) 

Next let us consider admissible vectors. The proof turns out to be largely 
analogous to the proof for the toy example, once the L 2 -convolution theorem 
is established. But this is now a formality. 

Theorem 4.18. For f,g £ L 2 (G) we have V g f £ L 2 (G) iff ([ f(a)g(a )* 
G cr ]) cre g £ B® ■ In this case, we have UQ-almost everywhere 

(V g f) A (a) = lf(a)g(ayC a } . (4.9) 

In terms of operator domains, this means that 

dom(U 9 ) = {f£ L 2 (G) : ([/(a)^)* C.])^ e B®} . 
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Proof. Apply Theorem 4.15 to A a := f(cr)g(a)*, and observe that the unitar- 
ity of Plancherel transform yields 

( V gf)( x ) = (f^G(x)g) = [ tr (A a <j(x)*)dv G (x) . 

JG 

Now we only need to note some technical facts concerning multiplication 
operators on tensor products, and the criteria for admissibility and bounded- 
ness can be derived. 

Lemma 4.19. Let 74,/Ci,/C2 be Hilbert spaces. Given a densely defined oper- 
ator A : IC 2 —* ICi, consider the operator A : 74 <S> fc\ — * Tt (g> IC 2 defined by 
letting T 1 — > \TA\, for all T £ Tt ® K,\ for which a bounded extension from 
dom(A) exists and is in /C 2 . 

(a) A is closed. 

(b) A is bounded iff A has a bounded extension. 

(c) Now assume A = S*C, where S £ 74(g>/Ci, and C : hi — > 'LL is selfadjoint, 
with /Ci,/C 2 C 74. If S = Ylj£j a 3 ® l Pj' f or some ONB (ipj)j^j ofIC, then 

A is isometric 4 => (aj)j^j C dom(C') and {Caf)j^j is an ONS . 

(4.10) 

Proof. For part (a) we pick a basis (Vi)ie 1 of 74 1 to write arbitrary elements 
of 74 <S> /Ci as 

S ="^2 r]i® bi . 

iei 

Then dom(A) consists of all such S for which C doirifd*) with 

Yliei || A* bi || 2 < 00 , and then 

AS = '^2 Vi ® A* bi . 

iei 

Since A* is closed, it is easy to conclude from this that A is closed. 

Moreover observe that the fact 

I|AS|| 2 = £||A*M 2 , 

iei 

clearly entails that A is bounded iff A* is bounded, which entails (b). 

For part (c) observe that the same argument proving (6) yields that A 
is isometric iff A* = CS is isometric. It is straightforward to conclude that 
( a j)j£j C dom(A), and 



CS ='22(Ca j )®y j . 

j&J 

Since an isometry is characterized by the fact that the ONB (c Pj)j^j must be 
mapped onto an ONS, ( Caj)j & j is an ONS iff CS is isometric. 
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Compare the following theorem to Theorem 2.64. The sufficiency of the 
criteria may be found in [53]. For unimodular groups, the characterization 
of selfadjoint convolution operators on the Fourier side was proved by Carey 

[29]. 

Theorem 4.20. Let TL C L 2 (G) be a leftinvariant closed subspace, with or- 
thogonal projection P ~ (l0P a ) q. Then we have the following equivalences 
for 77 G TL 

77 is admissible 4=4 [C a r}(a)\ is an isometry on P a {fH a ) , (4-11) 

77 is bounded 4=4 er 1 — > || [C' cr 7 /(er )]|| 00 is essentially bounded , (4.12) 
?7 is cyclic 4=4 er 1 — > || [C' (T 7 /(er )]|| 00 is injective on P a (TL a ) . (4.13) 

Bounded vectors fulfill HV^Hoo = esssup CTg g || C a ? 7 (cr) || oo - Moreover, S £ L 2 (G) 
is a selfadjoint convolution idempotent ijf [G,jS(cr)] is a projection, for vq- 
almost every a . 

Proof. The chief technical difficulty remaining for the proof of necessity is that 
the L 2 -convolution theorem for V v f holds only pointwise a.e. on the Planclrerel 
transform side, and in principle the conull set may depend on /. Hence we 
need some additional functional analysis to make the argument work. 

Pick a countable total subset S C L 2 (G). Then {/(cr) : / £ S} is total in 
Tt c r, for almost every cr; otherwise one could construct (measurably) the pro- 
jections onto the nontrivial complements and obtain a nontrivial complement 
in L 2 (G). Suppose that 77 is a bounded vector, say | K/||oc < k. Then we find 
by Theorem 4.18 that for all f £ S 

/ \\[f{vMv)*Ca}\\ldv G (cr)<k 2 ||/(cr)|| 2 c^ G (cr) . 

Jg Jg 

Passing from / to (/(CT)ls(cr)) (Tg g, for a Borel subset B, we see that we replace 
G as integration domain on both sides by B. Since B can be arbitrary, this 
implies the inequality for the integrands, i.e., 

\ma)g(a)*C a )\\l<k^na)\\l . 

Now the totality of {/(cr) : f £ S} shows that the inequality holds on a dense 
subspace of H a , for almost all a £ G. Then parts (a) and (b) of Lemma 4.19 
apply to yield that r}(cr)*C a is bounded, and norm < k almost everywhere 
follows by density considerations. 

The remaining necessary conditions in (4.12) and (4.11), as well as the 
norm equality 

Halloo = ess sup 1 1 G CT 77 (cr) I loo . 
creG 

(4.13) follow similarly. The converse directions are immediate from Theorem 
4.18. Since S' is a selfadjoint convolution idempotent iff Vs is a projection 
operator, the last statement is immediate. 
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Remark f.21. The differences between the unimodular and the nonunimodular 
cases can be exemplified by the following observation: To any / £ L 1 (G) ft 
L 2 (G) we can associate at least three objects on the Fourier transform side: 
The Fourier transform (<j(/)) cre g, the Plancherel transform (f(cr)) aG Q, and 
the decomposition of the operator V g ~ (1 ® T a ) a& Q. In the unimodular case, 
all three objects are basically identical: /(ct) = cr(/) and T„ = cr (/)*. In the 
nonunimodular case however, they all differ by suitable powers of the Duflo- 
Moore operator. 

Now we can easily characterize the subrepresentations of A G with admissi- 
ble vectors. The statement concerning unimodular groups is partly contained 
in [29, Theorem 2.10]; in this form the theorem appeared in [53]. A special 
case of the theorem for the reals was given in Theorem 2.65. Also, the dis- 
cussion of direct sums of discrete series representations contained in Remark 
2.32, in particular for unimodular groups, is a special case of this theorem. 

Theorem 4.22. Let Li C L 2 (G) be a leftinvariant closed subspace, and let 
P ~ (lgiPo-j^g denote the projection onto Li. Then TL has admissible vectors 
iff either 

• G is unimodular, almost all P a have finite rank and 



r'n = rank (P a )dvG{cr) < oo . (4-14) 

JG 

In this case every admissible vector g £ hi fulfills ||g|| 2 = vu- 
• G is nonunimodular. In that case, there exist admissible vectors with ar- 
bitrarily small or big norm. 



Proof. Assume first that G is unimodular. Suppose g is an admissible vector 
for H, and define h = g* * g. Then we have P = (V g )* o (V g ) = V g * ° V g = 14 
and h = V g *g* £ L 2 (G) (note that V g * is a bounded operator on all of L 2 (G)). 
Applying Theorem 4.18 first to Vj, and then to V g * yields 



P a = h(a)* = g(a)*g(a) , 
t'G-almost everywhere. Hence 



llsll 2 = / tr(<j(CT)5(a)*)d^(cr) 

JG 

= / tr (g(a)*g(a))diy G (<j) 

JG 

= / rank(P CT )dz/ G (cr) . 
JG 



For the sufficiency of (4.14) we note that (Pa) ae Q £ B®, and we let g be the 
inverse Plancherel transform of that. Then Theorem 4.18 shows that P = V g , 
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which means that V g is the identity operator on Li, and g is admissible. 

In the nonunimodular case, the statement follows from Theorem 4.23 and its 
corollary. 

Theorem 4.23. Let G be nonunimodular. Then there exists an operator field 
(A c r) ae Q £ £>® such that [C a A a ] is an isometry, for VG~almost every a £ G. 
As a consequence, if a £ L 2 (G) is the preimage of A under the Plancherel 
transform, a is admissible for A g- 

Proof. The proof uses the techniques and objects described in detail in Sec- 
tion 3.8.2, in particular the notions from Proposition 3.50. We first give 
the A a pointwise and postpone the questions of measurability and square- 

i /o 

integrability. Pick c > 1 in such a way that {7 £ H : 1 < A G ' (7) < c} 
has positive Haar measure, and define, for n £ N, S n := {7 £ H : c" < 
A~ 1/2 { 7) < c n+1 }. Let «)„ eN C H« = L 2 (H,dn H -,H T{a) ) be an ONB. 
Moreover let C L 2 (H, dgu\ ht T ^) be a sequence of unit vectors with 

supp(tA) C S n . Define the operator A a by 

A a = Y.\\ A ~G ,2 <r 1 <®< • 

nSN 



This defines a Hilbert-Schmidt operator, since ||Z\ ( A 1 ^ 2 i^|| > c n . 

On the other hand, the construction of the vf implies that A a maps H a 
into dom(C' C r). In fact, given any / = J2n£n(f’ u n) u n> the disjointness of the 
supports of the vif implies for all h £ H that 



A a f(h) = Y,\\AG 1/2 vZ\\~ 1 (f,uX(h) 



neN 



\\A g 1/2 <\\ 1 (f^ u n)K( h ) ■ h£ S„ for some n 
0 : otherwise 



Thus 



\\C a A a f\\ 2 = ^ 

n6N 

= El(/’OI 2 \\ A ~g /2 <\\~ 2 I \\Aa 1 / 2 (hK(h)\\ 2 dh 

neN J S n 

= ll/f ■ 

Therefore C a A a is an isometry. 

Let us next address the measurability requirement. We have already con- 
structed a measurable family of ONB’s, so we only have to ensure 

that the images (||Z\q 1 ^ 2 u^|| _ 1 u^)„ 6 n can be chosen measurably as well. Pick 
any family (&„) n gN C L 2 (IL) of unit vectors, such that b n is supported in S n . 



\^G 1,2 <r 2 



A~ l/2 {h){f,u° n ) <(/i) 
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Moreover, let (C CT )<jey be a measurable field of unit vectors € H T ( ff ), and 
define v £ = b n ^ a . Then 

(\\A- 1/2a n \\-' v °,a n el) = ||Z\g 1/2 a„||“ 1 (6„,a n )(5 <T ,e^) 

is measurable by the choice of the . 

Finally, let us provide for square-integrability. For this purpose we ob- 
serve that we may assume the constant c picked above to be > 2, and 
then HArlll < 2. Moreover, if we shift the construction in the sense that 

uf ||^G 1 ^ 2 ' u ra+fell _1 ' L ’ra+fe’ f° r & > 0) we obtain || ||| < 2 1_fc , while preserv- 
ing all the other properties of A„. With this in mind, we can easily modify the 
construction to obtain an element of B ® : Since G is separable, vq is cr-finite, 
i.e., G = U„cm En with the E n pairwise disjoint and VQ(S n ) < oo. Shifting on 
S n by k n £ N with 2~ kn < 2~ n ensures square-integrability without 

destroying measurability. (The latter is obvious on S n .) Hence we are done. 

The shifting argument employed in the proof also provides the following 
fact. 

Corollary 4.24. The operator field (A^) q from Theorem f.23 can he con- 
structed with arbitrarily small or big norm. 

The following corollary is obtained by combining Theorems 2.42 and 4.22. 
We expect that it has already been noted elsewhere; it can also be derived 
from the results in the paper by Arnal and Ludwig [14]. 

Corollary 4.25. Let G be a nondiscrete unimodular group. Then 

/ dim (TLc^dva^) = oo . 

Jd 

For completeness, we note the following characterization of unimodularity, 
which follows from Theorems 2.42 and 4.22. 

Corollary 4.26. Let G be a nondiscrete group. Then Xq has an admissible 
vector iff G is nonunimodular 

Theorem 4.22 and Corollary 3.51 imply the following remarkable property. 

Corollary 4.27. Suppose that G is a nonunimodular group. Let i t be a repre- 
sentation of G, and assume that tt = © ngN 7r„. If each n n has an admissible 
vector, so does n. 

The corollary can be applied to the results of Liu and Peng [83] to con- 
struct a continuous wavelet transform on the Heisenberg group H. The authors 
considered a particular group extension IxR and its action on L 2 (H) for the 
construction of wavelet transforms. They established that this representation 
decomposes into an infinite direct sum of discrete series representations, and 
they gave admissibility conditions for each. Now the corollary provides the 
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existence of an admissible vector for the whole representation. Corollary 5.28 
below shows that this type of construction in fact works for arbitrary homo- 
geneous Lie groups. 

We next give a generalization of the qualitative uncertainty principle to 
nonunimodular groups. For the unimodular version, confer [14]. 

Corollary 4.28. Suppose that G has a noncompact connected component. For 
f € L 2 (G) let P CT denote the projection onto ^Ker(/(tr))^ , and assume that 

r(a) = \\[P a C- 1 ]\\t 

is well-defined and finite vc-almost everywhere. Note that in the unimodular 
case r(cr) = rank (f(a)). Suppose that f fulfills 

(i) |supp(/)| < oo and 
(ii) fQr(a)dna(o- ) < oo. 

Then / = 0. 

Proof. Consider the operators S ( 7 = [C“ 1 P (T ], by assumption (5'<j) (Te g € Bf . 
If we let S denote the inverse Planclrerel transform of that, the L 2 -convolution 
Theorem entails that 

(Vsf) A = {[f(a)P a C^C a ])^ d = f , 

since by construction f(a) o P a = f(a). In other words, / = Vsf = f * S*. 
Moreover, since [C (T /S' (T ] = P a is a projection operator, S = S* by Theorem 
4.20, and thus f = f * S. Now assumption ( i ) and Theorem 2.45 imply / = 0. 

Remark j.29. In the real case condition (ii) specializes to the well-known con- 
dition |supp(/)| < oo; this is our excuse for calling Corollary 4.28 a qualitative 
uncertainty principle. In the unimodular case the analogy to the qualitative 
uncertainty property is still quite comprehensible: The Planclrerel measure of 
the support of / is simply weighted with the rank of f(c r). If we let H denote 
the leftinvariant closed subspace generated by /, then jQr(a)dvc(<j) = jsh, 
the latter being the constant encountered in Theorem 4.22. 

For nonunimodular groups the quantity Jg r(a)duG(cr) is more difficult to 
interpret. It is however independent of the choice of Planclrerel measure: If we 
pass to an alternative pair (uq, (C (7 ) (j£ g) of Planclrerel measure and associated 
Duflo-Moore-operators and define r using the C a , the renormalizations of uq 
and C a cancel to yield 




126 4 Plancherel Inversion and Wavelet Transforms 



Let us next consider T4, i.e. , the question how to make the criteria derived for 
the regular representation applicable to arbitrary representations n. We in- 
tend to employ the existence and uniqueness of direct integral decompositions 
for this task: Decomposing 7r into irreducibles, we can check containment in 
A g by comparing the underlying measure to Plancherel measure, and compar- 
ing multiplicities (if necessary). Moreover, once containment is established in 
this way, the admissibility conditions for Xq directly carry over to the direct 
integral decomposition of 7 r, much in the way that we could directly establish 
admissibility criteria for representations of M, as described in Remark 2.70. 
Using Lemma 4.19(c), we can in addition break the admissibility condition 
formulated for operator fields down to conditions involving rank-one opera- 
tors. Thus we obtain orthogonality conditions generalizing the discrete series 
case from Theorem 2.31. 

Remark ^.30. Given an arbitrary representation of a type I group, the 

following steps need to be carried out for establishing admissibility conditions: 

• Explicitly construct a unitary intertwining operator 
T : Htt — ► r dv(a) 



/*® 

/ m 7r (cr) • a dv{a) 
JG 



where v is a suitable measure on G and to is a multiplicity function. 

• There exist admissible vectors if and only if the following questions are 
answered in the affirmative: 

- Is v ryj-absolutely continuous? 

- Is m n (a) < dim(74 cr ), ^-almost everywhere? 

- If G is unimodular, does the relation 



/ m^iyd )di i G {& ) < 00 
JG 



Note that if G is nonunimodular, the answer to the second question is 
”yes” by Corollary 3.51. 

Compute the Radon-Nikodym derivative 

If G is nonunimodular, compute the Duflo-Moore operators C a , using e.g. 
the description in Proposition 3.50, or the semi-invariance relation (3.51). 
T maps vectors 77 € to measurable families (( Trj){<j , i)) ae Q i=1 m ^ . 
Then 77 is admissible iff it fulfills the following orthonormality relations, 
for 7 /cj-almost every a £ E: 



\C a (Trj)(a,i)\\ = 1, for 1 < i < 



(4.15) 



{Ccr(Tr])(<j, i), C rT (Tr])(a,j)) =0, for 1 < * < j < m n (a) (4.16) 
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Note that conditions (4.15) and (4.16) implicitly contain that (Trj)(a,i) € 
dom(C,j). Clearly, for the admissibility conditions to be explicit, T, the C a 
and need to be known explicitly. The next chapter is devoted to carrying 
this program out for a rather general setting. 

In the simplest possible case, i.e, G unimodular, 7r multiplicity-free and 
v = vq, the admissibility condition reduces to 

||(T? 7 )(ct)|| = 1, uq — almost everywhere on £ . (4-17) 



We close the section with a partial converse of the results in the last 
remark, at least for unimodular groups: Any admissibility condition which has 
a similar structure as the admissibility criterion (4.15) and (4.16) necessarily 
has to coincide with it. Also, the admissibility condition characterizes the 
canonical Plancherel measure. We expect this statement to hold for arbitrary 
groups, but have preferred only to deal with the unimodular case and to 
avoid the problems that arise from the Duflo-Moore operators. For certain 
representations however, an analogous result is derived in Theorem 5.23. 

In any case the next theorem provides further evidence for the central 
thesis of this book, namely that computing admissible vectors is in a sense 
equivalent to computing Plancherel measure. The following subsection will 
show that this observation actually extends to the type I condition. 

Theorem 4.31. Let G be unimodular. Suppose that 



/*® 

7 r = / m(x)a x dv{x) (4-18) 

J x 

is a direct integral representation, where X is a standard Borel space with 
a-finite measure v, m : X — > N U {oo} is a Borel map and {cr x )x£X is a mea- 
surable field of representations of G. Assume that the admissibility criterion 



( 4 ) 



a:£X,i=l,...,m(a:) ^ CtdlTlissiblc 
{Vx)i=i,...,m(x) is an ONS for is-a.e.x £ X . 



(4.19) 



holds and that there exist vectors 77 fidfilling it. 

(a) There exists a v-conull subset X' C X such that x 1 — > a x is a Borel 
embedding X' G. 

(b) In this identification, v is the restriction of vq to a suitable subset of G. 

Proof. Let 7To = <j x dv(x), and the associated representation space. 
We first prove that (4.19) entails 
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\\VM = f IMI 2 Uxfdu(x) , (4.20) 

Jx 

for all vector fields ij = (r) x ) x ex,<l> = {(f>x)xex G 'H 7To , in the extended sense 
that V v 4> L 2 (G) whenever the right hand side is infinite. For this purpose 

define the auxiliary vector field rj € 7i n , by letting 

i = iMr v , 



and choosing rj x ) j, i = 2 , . . . , ?n(;r) orthonormal to each other and to t) x , when- 
ever 77a; yf 0. For those x for which rj x = 0, we pick an arbitrary orthonormal 
system rj x ,i , i = 1 , . . . , m(x) (arbitrary within the measurability requirement, 
that is) . Note that the assumption that there exists a square-integrable vector 
field fulfilling the admissibility condition implies that m(x) < dim(7-fj;)) as 
well as 

/ m(x) disfa) < oo . 

Jx 

Hence rj can be constructed and is square-integrable^as well. Moreover it is 
admissible by assumption. Next define a vector field (f> by 



&x,i 



\\r)x\\<t>x * = 1 

0 i = 2 , . . . , m(x) ’ 



and assume for the moment that (j> is square-integrable, i.e., in TC n . Then 

m(x) ~ 

V vHy) = / ^ <7x{y)rjx,i)dv( x) 

Jx i=1 

= / {<j>x,<7x(y) , nx)di'(x) 

Jx 

= v v <t>(y) ■ 

Hence admissibility of rj entails 

Ml2 = M 2 = / hxf \\4>x\\ 2 dv{x) . 

Jx 

This proves (4.20) for the case that the right-hand side is finite; the general 
case is easily obtained by plugging in restrictions of (j) to suitable Borel subsets 
B CX. 

Now part (a) follows from Theorem 4.32 below. For part (b) we note that 
by part (a) (4.18) is a decomposition into irreducibles, hence Theorem 3.25 
yields that vq and v are equivalent. 

Moreover, we can conclude in the same way that (4.20) holds also with vq 
replacing v , by the admissibility criterion (4.17). Plugging in 77 with 1 1 77^ 1 1 = 1 
almost everywhere yields 

f \Wx\\ 2 dv G {x) = [ \\<p x \\ 2 dv{x) 

JX Jx 

for all vector fields ip. Hence u = vq- 
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4.4 Admissibility Criteria and the Type I Condition** 

In this section we comment on the relation of the type I property to the 
existence of admissibility conditions. A major motivation for tackling non- 
type I groups is provided by discrete G : Here A<y is type I iff G itself is [70], 
and the latter is the case only if G is a finite extension of an abelian normal 
subgroup [111], i.e., very rarely. 

The following theorem shows that for any direct integral representation 7r 
with associated admissibility conditions as in Remark 4.30, 7r is necessarily 
type I. Thus admissibility criteria outside the type I setting will have to be of 
a different nature. 

Theorem 4.32. Let G be unimodular, not necessarily of type I. Suppose that 
7 r = fy m(x)a x dv(x) is a direct integral representation, where X is a standard 
Borel space with a-finite measure v, m : X — > N U {oo} is a Borel map 
and ( <J x )x£X is a measurable field of representations of G. Assume that the 
admissibility criterion 

(4) is admissible 211 

<£=>• (f x )i=i,...,m(x) is an ONS for v-a.e.x £ X . ' ‘ 

holds and that there exist vectors p fidfilling it. Then 7 r is type I. 

Proof. Just as in the proof of Theorem 4.31, let 7r 0 = /® a x dv(x), and H no 
the associated representation space. Recall from the proof of 4.31 that 

\\V v m = f \\Vx\\ 2 Hx\\ 2 dv(x) . (4.22) 

J x 

Observe that the proof of that equation did not rely on the type I property 

of 7T. 

We are going to show that 7To is multiplicity- free. Since 7r « 7To, the type I 
property of 7 r then follows immediately. Let K, C H no be an invariant subspace. 
7T is cyclic by assumption, hence there exists a cyclic vector ip for the subspace 
1C as well. Then (4.22) allows to compute the orthogonal complement of K, in 
TL 7 tq as 

AC X = {<P : V, *<p = 0} 

= {</> : 1 1 (p x 1 1 1 1 ip x 1 1 = 0, v — almost everywhere } . 

But this entails that the projection onto K, is given by pointwise multiplica- 
tion with the characteristic function of {x £ X : ip x ^ 0}. It follows that 
all invariant projections commute, and thus the commuting algebra of 7To is 
commutative. 

Remark f.33. If 7r is as in the theorem, then 7r is a subrepresentation of A q, 
the type I part of Xq, and v is absolutely continuous with respect to the 
measure vq on G underlying the decomposition of A q into irreducibles. 
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We are not aware of a systematic treatment of admissibility conditions 
outside the type I setting. There exists a substitute for the Plancherel theorem, 
see e.g. [35, 18.7.7], which uses the theory of traces and their decomposition. 
Some use of this result can be made to formulate admissibility criteria in the 
general setting, see [55] . 



4.5 Wigner Functions Associated to Nilpotent Lie 
Groups** 

In this section we sketch the construction of Wigner functions associated to 
certain representations of nilpotent Lie groups. A full understanding of the 
results requires knowledge of Kirillov’s theory of coadjoint orbits and their use 
in constructing the unitary dual. We refrain from giving an introduction to 
this theory here, and refer the interested reader to [30, 72] for details. While 
the results only hold in a specific context, they serve as an example how 
representation theory can provide a unified view of phenomena connected 
to continuous wavelet transforms. Also, several ideas that have occurred in 
the discussion so far make their appearance in this section: The extension of 
orthogonality relations to Hilbert-Schmidt-operators, as used in the proof of 
2.33, or the problem of decomposing operators over a direct integral space. 
The latter problem will be seen to connect nicely to Kirillov’s orbit theory. 

The Wigner transform is intended as a symbol calculus associating to an 
operator on a certain Hilbert space a function on a phase space, i.e. , to an 
observable in the quantum mechanical sense an observable in the classical 
sense. The original Wigner transform is closely related to the Heisenberg group 
(see the next subsection). The authors of [24] demonstrated how one could 
replace the Heisenberg group by the affine group and thus arrive at a different 
symbol calculus. As a matter of fact, there are various constructions based on 
different choices of groups around, see for instance [11, 12, 96, 24, 2]. In the 
following we will be concerned only with [2] and a variation of the construction, 
presented in [4]. The appeal of the approach presented here derives from the 
way it highlights the role of the Plancherel transform in the construction. The 
relations between this construction and the various other definitions of symbol 
calculi to be found in the literature are not entirely clear to us, and we do not 
have a particular claim to originality. 

The authors of [2] singled out two main ingredients of the construction: 
A discrete series representation of the underlying group, with the associated 
orthogonality relations, and a Euclidean Fourier transform on the group ob- 
tained from an identification with its Lie algebra via the exponential map. [4] 
then showed how this construction generalizes to cases where discrete series 
representations are not available. We present a discussion which is suited to 
simply connected, connected nilpotent Lie groups; extensions to exponential 
Lie groups are possible. 
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The Original Wigner Transform 

The starting point of the construction is the Heisenberg group H. As a set, 
G = R 3 , with the group law 

(P, Qi q', t') = (p + p',q + q', t + t' + ( qp - qp)/2) . 

The comparison with Example 2.27 shows that the reduced Heisenberg group 
H r is the quotient group of H by the discrete central subgroup {0} x {0} x 
{2-7 tZ}. For the time being, this difference does not really matter, since in this 
subsection we are dealing with the windowed Fourier transform and ignore the 
action of the center {0} x {0} x R. However, for the connection to Kirillov’s 
theory later on it is crucial to have a simply connected group. 

Recall that 



Wf 9 (p,q)= f g(x)f(x+p)e- 2 ^ x+ r^dx 

JR 

Now the fact that W/ is isometric iff ||/|| = 1 entails that 



I|W/.9|| L 2(k2) = \\f\\. 



W^g 

TT71T 



= \\fh \\9h 



for arbitrary 0 / /,j € L 2 (R) . Then polarization provides the biorthogo- 
nality relation 



(W/jffl, W/ 2 5 r 2)L 2 (R 2 ) — (f2,fl)(gi,92) ; (4.23) 

similar arguments were used in connection with the orthogonality relations 
(2.15) for general discrete series representations. Since the right-hand side is 
nothing but the Hilbert-Schmidt scalar product of the two rank-one operators 
g i (g> fi and go, ® f 2 , we find that the mapping 

W:(f,g)^W f g 

linearly extends to a unique isometry W : £> 2 (L 2 (R)) — > L 2 (R 2 ). As a matter 
of fact the map is onto, hence unitary. Now the Wigner transform, which 
we denote by 2H, is obtained by taking the usual scalar-valued Plancherel 
transform after W, i.e., formally 

W(g®f)(P*,q*)= [ f yV f g(p,q)e- 2 ^^^dpdq 

Jr Jr 

= J^ e -2*i P * Pg (_ q *_^ f (_ q * + iy p . (4.24) 

Here the second equality is Fourier inversion. 

Let us collect the main properties of the operator 23J : f? 2 (L 2 (R)) — > 
L 2 (R 2 ): 
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• Unitarity, usually expressed in the overlap condition [2], or Moyal’s 
identity 

(2n(sri ®/), 2ff(s2 ® / 2)) = {gi,gi)(h,h) ■ 

• Covariance: If A G ^2(L 2 (]R)), then 

W(Tr(p,q,t)An(p,q,t)*)(p',q') = W(A)(p' -p,q' - q) . 

This is verified by direct calculation for rank-one operators and extends 
by density to arbitrary Hilbert-Schmidt operators. 

• Reality: If deB 2 (L 2 (R)), then 

2B(A*) = W{A) . 

Again, this is easily seen for rank-one operators. 

Note that our calculations in this subsection are somewhat ad hoc. In 
particular the group-theoretic significance is not clear, since we considered re- 
strictions to the subset I 2 x{l}cG, which is uot a subgroup. The construc- 
tion of the Fourier- Wigner operator from (restrictions of) wavelet coefficients 
closely resembles Plancherel inversion. This observation will be the basis of 
the general approach for the construction of a transform with the above three 
properties, which works for arbitrary simply connected nilpotent groups. 

Wigner Functions Associated to Nilpotent Lie Groups 

Let A be a simply connected, connected nilpotent Lie group, with Lie algebra 
n. The basic facts concerning these groups, as used in the following, are con- 
tained in [30]. N is an exponential Lie group, i.e. , the exponential mapping 
exp : n — » N is bijective. Moreover, the image measure under exp of Lebesgue 
measure on n turns out to be left- and riglrtinvariant on N [30, Proposition 
1.2.9]. Let L 2 (n) denote the L 2 -space with respect to Lebesgue measure, then 
we obtain a unitary map EXP* : L 2 (A) 9 / i— > / o exp £ L 2 (n). Finally, we 
let V n ■ L 2 (n) — > L 2 (n*) denote the usual Euclidean Plancherel transform, 
defined on L 2 (n) D L 1 (n) by 

V n (f)(X*) = [ f(X)e~ i < x ’ x ^dX , 

J n 

where dX is Lebesgue measure and (X,X*) denotes the duality between n 
and n*. For a suitable normalization of Lebesgue measure on n* the map is 
unitary. Now we define the global Wigner transform 2IT : B® — * L 2 (n*) as 

2U = Vn o EXP* o -p- 1 



The construction entails the following theorem. We let Ad and Ad* denote 
the adjoint resp. coadjoint actions of N on n resp. n*. Ad is obtained by 
differentiating the conjugation action of N on itself, which gives rise to a 
linear action of N on n. Ad* is obtained by transposing this action. 
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Theorem 4.34. (a) 2U is unitary. 

(b) 2T is covariant; For all (A a ) ae ^ G £>®, for all x G N, 

W((a(x)A <7 a(x)*) aG fj)(X*) = 2U(Ad* (a;)X*) almost everywhere. 

(c) 23J is real: For all ( A a ) a ^ G Z?®, 

W{{A* a ) a ^){X*) = W((A a ) aeff )(X*) . 

Proof. Part (a) is obvious from the definition. For part (b) we first use 
the intertwining property of the Plancherel transform to see that, for a = 
V~\{A a ) a ^), 



V 1 ((a(x)A cr a(x)*) ae ^)(y) = a(x l yx) 
Moreover, we have the fundamental relation (see [30]) 
exp((Acl)(a;)F) = x exp(T) x~ x , 



as well as 



Vnif oAd(x))(X*)= [ f(Ad(x)Y)e i< ' Y,x *' > dX 

J n 

= f f(Y)e i< ' Ad( - x ~ 1 ^ Y,x *' > dX 

J n 

= f ffYy^^W^dX 

J n 



= V n (f)(Ad*(x)X*) 



Combining these covariances gives (b). For part (c) observe that by Lemma 
4.14 (iv) 

V N (a*) = (A*)^ , 

and we recall that a*(x) = a(x~ x ). Since exp(— X) = exp(A)“ 1 , EXP* inter- 
twines the involution on L 2 (iV) with the analogous involution on n, viewed as 
a vector group. But this implies (c). 

While this result was pleasantly simple to prove, it is still not clear how 
to recover the original Wigner transform from it; after all the latter maps 
single Hilbert-Schmidt operators to functions in two variables, not fields of 
operators to functions in three variables. As will be seen below, the missing 
link is provided by the role of the coacljoint orbits in the computation of N 
and hn - This brings up Kirillov’s orbit method. 

The central result of harmonic analysis on nilpotent Lie group is the exis- 
tence of the Kirillov correspondence, which is a bijection 



k : n*/Ad*(A0 -> N . 
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In fact it is a Borel isomorphism, if we endow the right hand side with the 
Mackey Borel structure and the left hand side with the quotient structure. 
We denote the inverse mapping by K~ 1 (a) = O*. The orbit space is countably 
separated, i.e. , N is type I. 

Besides providing a scheme to compute N, or at least a parametrization of 
it, the coadjoint orbits also give access to the Plancherel measure: Since the 
orbit space is countably separated, there exists a measure decomposition 

dX* = dp 0 (X*)dv(0) 

of Lebesgue measure on n* (see Proposition 3.28), and it can be chosen in 
such a way that the image measure of v under n is precisely v ^ [72] . 

By Proposition 3.29 the measure decomposition gives rise to a direct inte- 
gral decomposition of L 2 (n*), namely 

L 2 (n*,dA)~ ^ L 2 (0,dp 0 ) dv{<D) . 

4n*/Ad*(G) 

Now 2U can be read as an operator between two direct integral spaces, (es- 
sentially) based on the same measure space, and the following definition is 
natural: 

Definition 4.35. The Wigner transform 2D decomposes if there exists a 
conull, Ad* (N) -invariant Borel set C C n*, and a field of operators 

W a :B 2 (H a )^L 2 (0* a ,[io*) 

for all a £ N with O* C C, such that the following relation on Bf holds: 

2H((A,) ct6J v) = (2U a(A a ))^ . (4.25) 

If the operators W a exist, they are called local Wigner transforms. 

Note that by definition the set of a £ G for which 2U CT is not defined has 
measure zero, hence (4.25) is meaningful for B® ■ 

Remark 4.36. (1) In the next subsection we will see that the concrete Wigner 
transform given above is a local Wigner operator in the sense of the definition. 
(2) The motivation for local Wigner operators is to obtain a correspondence 
between single operators and functions, instead of families of operators and 
(families of) functions. The desire to have Wigner functions supported by 
single coadjoint orbits is motivated by the applications of Wigner functions 
in mathematical physics. The Wigner transform is intended as a quantization 
procedure, assigning each operator on a given Hilbert space its symbol , i.e., 
a function on phase space. Now the symplectic structure on coadjoint orbits 
provides a natural interpretation of these orbits as phase spaces of physical 
systems, whereas n*, as a disjoint union of such phase spaces, does not readily 
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lend itself to such an interpretation. For more details on quantization and 
coadjoint orbits, we refer the reader to [62, 72]. 

(3) The construction can be extended to exponential groups. The extra cost 
consists mainly in having to deal with densities when passing from N to n, 
i.e, Haar measure of N need not coincide with Lebesgue measure. Also the 
group can be nonunimodular. Confer [2, 3] for examples. 

(4) The question whether 2JJ decomposes has the following representation- 
theoretic background: The proof of the covariance property in Theorem 4.34 
is based on the fact that TVoEXP* decomposes the conjugation representation 

x e-> \ G (x)g G (x) 

with the unitary action on L 2 (n*) induced by Ad*, whereas V intertwines it 
with the direct integral representation 



/*© 

/ 7 T 0 dv(0) , (4.26) 

J n*/Ad* (N) 

where 7 to is a representation acting on B-2('H K (o)) via 
tto{x)A = k(0)(x) ® k(0)(x) . 

Since both L 2 (n*) and /*/Ad*(iV) W-K{p))dv{0) can be viewed as direct in- 

tegral spaces based on the same measure space, the decomposition statement 
is natural. It is nontrivial, however: The point is that the decomposition (4.26) 
is not easily related to the decomposition of the conjugation representation 
into irreducibles. In particular, no may contain representations which cor- 
respond to coadjoint orbits other than O. Hence additional assumptions are 
necessary, as witnessed by the next theorem showing that the local Wigner 
operators exist only in very restrictive settings. 

Theorem 4.37. Let N be a simply connected , connected nilpotent Lie group. 
The Wigner transform on N decomposes iff there exists a conull Ad*(iV)- 
invariant Borel subset C C n* such that every coadjoint orbit in C is an 
affine subspace. 

Proof. We first prove that 20 decomposes iff there exists a conull Ad*(iV)- 
invariant Borel subset C C n* such that for all / € L 1 (A r ) fl L 2 (7V), and all 
er € N with O* C C, 

Mf)\\l= [ IW)M| 2 ^o;M . (4.27) 

Jo* 

Indeed, supposing that 20 decomposes, the right hand side is precisely 
|| 2Xr CT ( ct(/))||l 2 ( C ,,), and unitarity of 20 entails ^jv-almost everywhere that 20 CT 
is unitary. This proves the “only-if” part. 
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For the “if-part” we construct as follows: Fix a coadjoint orbit 0*, 
for a G C. By [30, 3.1.4], 0* is a closed submanifold of n*. Pick a function 
g € C[]”(n*), then Vn 1 (g) G L 1 (A^) n L 2 (iV). Moreover, the restriction of g to 
O* is in 0£°(0*). We define the operator G„ G Bzi'Ha) 

G a = a(V~\g)) 

We claim that G„ only depends on the restriction g\o * : Indeed, if h G C“(n*) 
fulfills h\o* = g\o j, then (4.27)yields 

Hence the operator : g\o * > G a is well-defined. Moreover, the assumption 

yields ||g|o^|| 2 = ||G<t|| 2 - Since 0* is a closed submanifold, the set of restric- 
tions of 0£° -functions is precisely 0£°(0*), which is dense in L 2 (0*). Hence 
TTo- has a unique isometric extension L 2 (0*) — > B^^Ha)- By construction, 
thus coincides with the direct integral of the field (TT (T ) ct6 c'> at least on 
Cc°( n *)- But this space is dense, hence we conclude that the Uk, are unitary, 
and 2U decomposes into the = 2J” 1 . 

Hence the equivalence is established, and we can finish by appealing to 
[85, Theorem 1] which states that (4.27) holds iff 0* is an affine subspace. 

Remark J^.38. There appears to be a way of defining local Wigner transforms 
outside the flat orbit case. It consists in replacing the operator V n by a different 
integral operator V^, the so-called adapted Fourier transform [10, 12, 13]. 
The transform is designed to ensure 

IK/)ll!= / IK d (/)M| 2 d/io-M , (4.28) 

Jo* 

and as in the proof of the theorem, this entails that the adapted Wigner 
transform 

22jad = d Q EX p* Q V -1 

decomposes. However, we have not been able to check whether the adapted 
transform has the covariance property. 



The Original Wigner Function Revisited 

Let us now compute the global Wigner transform for the Heisenberg group, 
and show how to recover the original Wigner transform from it. The formal 
calculations below can be made rigourous, either by restricting to suitable 
functions for which the integrals exist pointwise, or by weak arguments, i.e., 
taking scalar products with L 2 -functions and using Plancherel’s theorem in- 
stead of Fourier inversion. We have refrained from doing either. 

The Heisenberg Lie algebra of the group is f) = R 3 , with Lie bracket 
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[(p,Q,t), = (0,0 ,pq' -p'q) . 

The associated Lie group H can be thought of as f), endowed with the 
Campbell-Baker-Hausdorff formula, which yields the group structure 

( P , q , q', t') = (p + p',q + q', t + i! + {pq' - p'q)/ 2) . 

Note that taking for H the Lie algebra f) with Campbell-Baker Hausdorff 
formula amounts to taking the identity operator as exponential map. The 
adjoint representation of H on f) is computed as 

Ad (p, q, q', t') = (p' , q' , t' + pq - p'q) , 

and if ( p*,q*,t *) are the coordinates with respect to the dual basis, 

Ad *(p,q,t)(p*,q*,t*) = (p* + t*p, q* + t* q,t*) . 

It follows that the set of coadjoint orbits consists of the singletons {(p* , q* , 0)}, 
with ( p* ,q *) £ R 2 , and the hyperplanes O = M 2 x {t*}. The representation 
corresponding to O’/, under the Kirillov map is the Schrodinger represen- 
tation p_ t . (observe the sign change). Here Qt * acts on L 2 (R) via 

[et*(p,q,t)f\ (x) = e 2 ^ x+t * t+t *P‘i/ 2 )f{x + t*p) . 

Now the Plancherel measure is seen to be supported by the Schrodinger rep- 
resentations, where it is given by dv B {a t ,) = \t*\dt* [45, Section 7.6], with dt* 
denoting Lebesgue measure on the real line. 

We have now collected all necessary ingredients for the computation of 
2U. Note that we know already by Theorem 4.37 that 2T decomposes, so we 
will also be interested in the components. Pick a measurable field of rank-one 
operators R = ( gt * ® R' G Bf PI B f . Then the Plancherel inversion 

formula yields for r = V~ 1 (R) that 



r(p,q,t)= [ (gr,Q-f(p,q,t)fr)\t*\dt* 

Jw 

= 11 gt * (x)f t , (x - t^-^x-ft-fpq/ 2 ) 1 ^ 1 ^. 

Jw Jr 

Plugging this into the Euclidean Plancherel transform yields formally 

W(R)(p*,q*,S*) 

= [ g t , {x)f t , (x - t*p)e- 27!iiqx - t ' t - t ‘' pq/ 2 +<?* 9 + p * p +-*‘) \t*\dt* dxdpdqdt 

J R 5 



Now the integration against dxdq can be simplified by Fourier inversion to the 
substitution x e- > — q* + t*p/2, thus the integral becomes 
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4 Plancherel Inversion and Wavelet Transforms 



/ +t*p/2)f t .(-q* - i*p/2)e- 2,ri( - t * t+p * p+a * t) \t*\dt*dpdt 

J R 3 

= [ g s *(-q * + S*p/2)f s ,{-q* - s*p/2)e- 2 ^P\s*\dp . 

Jr 

Here another Fourier inversion allowed to discard the integral dtdt*, resulting 
in the substitution t* i— > s*. Now a closer look at the remaining term reveals 
that indeed the values of 2U(i?) on the coadjoint orbit K 2 x {s*} only depend 
on g s * (g) / s », and that the local Wigner operators are given by 

[2 Ms® /)](?*,<?*, o = M* f R 9 (~9* + S ~y) f (-9* - ^je-^dp . 

Now a comparison with (4.24) yields that the original Wigner transform dis- 
cussed above is just the local Wigner transform 23Ji. 
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Admissible Vectors for Group Extensions 



In this chapter we discuss a class of examples which has received considerable 
attention in recent years. The aim consists in making the abstract admissibility 
conditions developed in Chapter 4 explicit, in particular the criteria from 
Remark 4.30. Recall that this requires computing the Planclrerel measure as 
well as the direct integral decomposition of the representation at hand into 
irreducibles. We consider certain group extensions 

using the techniques of Kleppner and Lipsman from Section 3.6 for the com- 
putation of vq. Of particular interest will be the case where G = N x H, 
and 7T is the quasi-regular representation n = Ind ff l. The case N = R and 
H < GL(fc,R) has been studied by a number of authors, see the list below, 
and we start by discussing this setting by more or less basic arguments. In 
fact, Examples 2.28, 2.30 and 2.36 are all special cases of this setting. It turns 
out that the arguments dealing with these examples extend to the general case 
G = xi H, yielding elementary admissibility conditions which avoid explicit 
reference to the Planclrerel transform of G (Theorem 5.8). Having done that, 
we show in Theorem 5.23 how the concrete admissibility conditions relate to 
the scheme described in Remark 4.30. As a result we obtain a very concrete 
description of the various objects that enter the Planclrerel formula for the 
group under consideration. The argument is based on a general result about 
the containment of a quasi-regular representation in the regular representation 
(Theorem 5.22), which allows to conclude the existence of admissible vectors 
for a wide range of settings. 

The result can also be applied to cases where N is nonabelian; in particular 
when TV is a homogeneous Lie group and H a one-parameter group of dilations 
acting on N (Corollary 5.28). Finally, we show how the Zak transform criteria 
for Weyl-Heisenberg frames with integer oversampling can be regarded as 
admissibility conditions with respect to a certain discrete group. 

Thus the results of this chapter generalize and/or complement the findings 
of various authors: 
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• Murenzi’s [93] 2D continuous wavelet transform discussed in 2.30. 

• The dyadic wavelet transform of Mallat and Zhong [92] considered in 2.36 

• Bohnke [25] introduced H = R + • SOo(l, 1) and H = R + • SOo(2, 1). Again 
the representations were irreducible. 

• General characterizations of dilation groups H giving rise to discrete series 
subrepresentations of the quasiregular representation were given in [22, 50] . 

• Klauder, Isham and Streater [67, 74] considered H = SO (k) and H = 
SO(fc — 1, 1). As a matter of fact, the representations they consider are not 
explicitly defined as subrepresentations of 7r, but they are direct integrals 
which are immediately recognised as subrepresentations of the representa- 
tion 7 f obtained by conjugating tt with the Fourier transform on R fc . 

• Cyclic and one-parameter subgroups of GL(fc,R) were considered by 
Groclrenig, Kaniuth and Taylor [59] . A general discussion of discrete dila- 
tion groups can be found in [51]. 

• The characterization of dilation groups allowing the existence of admissible 
vectors was addressed in full generality in [77, 113], as well as in [52], and 
the discussion in the first two sections follows the latter paper closely. 

• Lemarie [78] established the existence of wavelet orthonormal bases on 
L 2 (.ZV), where N is a stratified Lie group. These bases arise from the action 
of a lattice in N and a discrete group of dilations, in an entirely analogous 
fashion to the multiresolution wavelets on R. Our results provide a con- 
tinuous analogue of these systems, for the larger class of homogeneous Lie 
groups. 

• Liu and Peng [83] considered a semidirect product H xi R, where R denotes 
a one-parameter group of dilations, and an associated quasi-regular repre- 
sentation 7r on L 2 (H). They then showed that 7r splits into discrete series 
representations, and gave admissibility conditions for each. Our results 
yield admissible vectors for tt itself. 

• Daubechies [33] (among other authors) characterized tight Gabor frames 
for the case of rational oversampling, making use of the Zak transform. The 
discussion in Section 5.5 exhibits this criterion as yet another instance of 
the scheme from Remark 4.30. 

The standing assumptions of this chapter are: G is a type I group, N <\ G 
is regularly embedded and type I. Whenever G is nonunimodular, we assume 
that the Ker(Z\< 3 ) has the same properties as N. The assumptions are chosen 
to allow to apply the results from the previous chapters. As the discussion 
of the concrete admissibility conditions shows, the conditions are somewhat 
more restrictive than seems necessary. However, for all concrete examples that 
have so far been considered in the literature, the standing assumptions can in 
fact be verified. 
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5.1 Quasiregular Representations and the Dual Orbit 
Space 

For this and the next section let H < GL(fc,R) be a closed subgroup, and 
G = x H. Elements of G are denoted by (a;, h) with x £ W. k and h £ H\ 
the group law is then given by (x 0 , ho)(xi, h\) = ( Xo + h 0 Xi,hohi). Left Haar 
measure of G is given by dga{x,h) = \ det(h)\~ 1 dxdy,H(h), and the modular 
function is computed as Ag{ x, h) = An{h)\ det(/i)| -1 . For simplicity we will 
sometimes write Ac{h) instead of Z\g(0,/i). The quasiregular representation 
7T of G acts on L 2 (R fe ) by 

{tt(x, h)f)(y ) = I det(/i)|” 1/2 /(/i -1 (y - x)). 

The closedness of H in GL(fc, R) may seem a somewhat arbitrary condition 
(Lie subgroups might also work), but it is in fact not a real restriction, because 
of the following fact. It was observed in [49, Proposition 5] for the discrete 
series case, but the proof does not use irreducibility. We reproduce it for the 
sake of completeness. 

Proposition 5.1. Let H be a subgroup o/GL(fc,R), endowed with some lo- 
cally compact group topology. Assume that the semidirect product R fc xi H is 
a topological semidirect product, and that the quasiregular representation has 
a nontrivial subrepresentation with an admissible vector. Then H is a closed 
subgroup o/GL(fc,R), and the topology on H is the relative topology. 

Proof. Since all wavelet coefficients vanish at infinity by 2.19, there exists 
a nontrivial Co matrix coefficient Vfg for ir. We may assume Vfg(e) = 1. 
Let Wfg denote the matrix coefficient of the quasiregular representation of 
R fc xi GL(/c,R) corresponding to the same pair of functions f,g. Then Vfg 
is the restriction of Wjg to xi H. Since Wfg is continuous, there exists a 
compact neighborhood U of 1 in GL(fc,R) with |W/(?| > 1/2 on U. U fl H 
is T-closed in H, since U is closed and T is finer than the relative topology. 
Since H is closed in xi H , the restriction of Vfg to H vanishes at infinity. 
By choice of U, this implies that U fl H is contained in a T-compact set, 
hence is T-compact itself. But then the inclusion map from U fl H to H is 
a lromeomorphism onto its image, being a continuous map from a compact 
space to a Hausdorff space. Hence T coincides on U fl H with the relative 
topology. Since U ft H is a neighborhood of 1 for both topologies, it follows 
that the neighborhood filters of both topologies at unity coincide. Since a 
group topology is uniquely determined by the neighborhoods at unity, the 
topologies themselves coincide. In particular the relative topology is locally 
compact, which means H is closed. 

Mackey’s theory directs our attention towards the dual action. As it turns 
out, the decomposition of the quasiregular representation is also closely related 
to the dual orbit space. Let us quickly recall the notions of Mackey’s theory 
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for this particular setup. The dual group R k is the character group of R fc , 
identified with itself. Denoting the usual scalar product on by (w, x) i— > 
w ■ x, the duality between and is given by 

(u, x) = e~ 2 ™- x . 

In this identification, the dual operation is given by 

h.u) = (/i 4 ) _1 w , (5.1) 

where the right-hand side denotes the product of a matrix with a column 
vector. M. k /H is the dual orbit space. For 7 G R fe , H 1 denotes the stabilizer 
of 7 in H\ it is a closed subgroup of H. 

For the discussion of subrepresentations of 7 r, it is useful to introduce the 
representation 7r obtained by conjugating n with the Fourier transform on R fc . 
It is readily seen to operate on L 2 (R fc ) via 

(n(x,h)f)(uj) = | det(/i)| 1 / 2 e -27riw ' :c /(/i -1 .w) . (5.2) 

The action of n allows to identify subrepresentations in a simple way: Every 
invariant closed subspace H C L 2 (R fc ) is of the form 

H = Hu = {g G L 2 (K fe ) : g vanishes outside of U } , 

where U C is a measurable, //-invariant subset (see [48] for a detailed 
argument). We let ttjj denote the subrepresentation acting on Hu- 

Remark 5.2. The structure of the dual orbit space As the structure of 
the dual orbit space is important for the decomposition of the quasi-regular 
representation and for the construction of admissible vectors on the one hand, 
but also for the computation of Planclrerel measure on the other, let us take a 
closer look at its measure-theoretic structure. For our discussion, the following 
two sets will be central 

l? c = {w G M. k : Hu is compact } , f2 rc = {uj G i? c : O(uj) \ is locally closed } . 

The set f2 rc c H c consists of the “regular” orbits in J7 C ; i.e., it is the “well- 
behaved” part of f? c . Loosely speaking, f? c is the set we have to deal with, 
and f2 rc is the set we can deal with. Put more precisely: While Theorem 
5.8 below shows that subrepresentations with admissible vectors necessarily 
correspond to invariant subsets U of L? c , the existence result in Theorem 5.12 
only considers subsets of the smaller set f2 rc . However, this distinction is not 
due to a shortcoming of our approach: Remark 5.13 gives an example of a 
subset of fl c that does not allow admissible vectors for the corresponding 
subrepresentation. 

The measure-theoretic properties of the two sets are summarized as fol- 
lows: n c can be shown to be measurable, see Corollary 5.6. But usually 12 c is 
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not open, even when it is conull, as is illustrated by the example of SL(2,Z): 
It is easy to see that fi c consists of all the vectors (uq, w 2 ) such that uq/uq is 
irrational. This is a conull set with dense complement in R 2 . 

By contrast, L2 rc is always open, by Proposition 5.7. A pleasant conse- 
quence of this is that Glimm’s Theorem [56] applies (since f2 rc is locally com- 
pact), which entails a number of useful properties of the orbit space fi rc /H : 
It is a standard Borel space having a measurable cross section f2 rc /H — > l? rc , 
and there exists a measurable transversal, i.e., a Borel subset A C fi rc meeting 
each orbit in precisely one point. 

Unfortunately, the example of SL(2,Z) shows that f2 rc can be empty even 
when fl c is conull: Q c contains no nonempty open set, since its complement 
is dense. 

The rest of the section is devoted to proving the measurability of Q c and 
the openness of f2 rc . The proof for the first result uses the subgroup space of 
H , as introduced by Fell [44]. 

Definition 5.3. Let G be a locally compact group. The subgroup space of 
G is the set K(G) := {H < G : H is closed }, endowed with the topology 
generated by the sets 

U(Vu-.',V n -,C) := {H e K(G) : H nb, + 0,V1 < i < n, H n C = 0}, 

where Vi, ... ,V n denotes any finite family of open subsets of G and C C G is 
compact. 

With this topology K[G) is a compact H aus dor ff space. 

The motivation for introducing the K{G) to our discussion is the following: 

Proposition 5.4. Let X be a countably separated Borel space, and G a locally 
compact group acting measurably on X . Consider the stabilizer map s : X — > 
K(G) defined by s(x) = {g € G : g.x = x}. Then s is Borel. 

Proof. That s indeed maps into K(G) is due to [17, Chapter I, Proposition 
3.7], the measurability is [17, Chapter II, Proposition 2.3]. 

Proposition 5.5. Let G be a a-compact, locally compact group. Then 
K C {G) = {H € K(G) : H is compact } is a Borel subset of K(G). 

Proof. We first construct a sequence of compact set (C n ) ne N such that A C 
G is relatively compact iff A C C n for some n £ N. For this purpose let 
G = UneN Kn with compact K n . Pick a compact neighborhood V of the unit 
elements, and define C n = V ■ UiLi C»- Then the open kernels of the C n cover 
G. Hence, if A C G is compact, the fact that the C n increase implies that 
A C C n for some n. It follows that 

K C (G) = |J {He K(G) : H (1 (G\ C n ) = 0} 

raSN 

= U K(G)\U(G\C n ,<b) 

ne N 
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is an F c r -set. 

Combining 5.4 and 5.5, we obtain the desired measurability. 

Corollary 5 . 6 . fl c is a Borel subset o/K fc . 

The proof of the following proposition uses ideas from [77]. 

Proposition 5 . 7 . Q rc is open. 

Proof. Define the e-stabilizer 

HI = {h £ H : | h.w — w\ < e} , 

where | • | denotes the euclidean norm on R fc . If Hff is compact for some e > 0, 
then B e (w) fl 0(w) = H^.w is compact. Here B e (x) denotes the closed e-ball 
around x. Hence the orbit O(w) is locally closed. 

Conversely, assume that B e (w) fl 0(w) is compact for some e > 0 and 
that H u is compact. There exists a measurable cross-section r : 0(w) — > H 
which maps compact sets in 0(w) to relatively compact sets in H. Hence 
C H u r(B e (w)) is relatively compact and closed, hence compact. 

In short, we have shown 

u> £ f2 rc 4=4> 3e > 0 : H * is compact , 

and we are going to use this characterization to prove the openness of fi rc . 

If the origin is in f2 rc , then H is compact, and l? rc = K fc . In the other case, 
pick u> in fl rc and e > 0 with compact. Since GL(fc,R) acts transitively on 
R fc \{0}, we may (possibly after passing to a smaller e) assume that there exists 
a continuous cross-section a : B e (u>) — * GL(fc,M) with relatively compact 
image, i.e. , a (7 ).ui = 7, for all 7 € B e (u>), and a(B e (u>)) C U, where U is a 
compact neighborhood of the identity in GL(/c,K). We are going to show that 
B e (io) C f2 rc . For this purpose let 7 € B e (u>). Clearly it is enough to prove 
that 



C := {h £ H : h. 7 £ B e (u)} = {h £ GL(/c,R) : h. 7 £ B e (u>)} fl H 
is relatively compact. By assumption, 

Hfj = {h £ GL(jfe,K) : h.u £ B t {u)} n H 

is compact. Hence 

C = {h £ GL(fc, K) : oja{^).h £ B e (uj)} fl H 
= a(7) -1 {/i £ GL(fc,K) : h.w € B e (uj)} fl H 
C U-\{h £ GL(jfe,K) : h.w £ B e (w)} n H) 

i.e., C is contained in the product of two compact sets, and thus relatively 
compact. Note that we used here that H is a closed subgroup of GL(/c,K), 
hence compactness in H is the same as compactness in GL(fc,R). 
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5.2 Concrete Admissibility Conditions 

We will now derive the admissibility condition for the quasiregular represen- 
tation and its subrepresentations. The proof of the admissibility condition is 
fairly straightforward. It is only when we address the existence of functions 
fulfilling the condition that we are forced to use more involved arguments. The 
theorem was derived for certain concrete groups H in [92, 67, 74], and the argu- 
ments presented in this section are generalizations of those in [92, 67, 74]. The 
general version given here appears also in [77, 52] . Note that the admissibility 
condition also figures as a part of the definition of the notion of “projection 
generating function” in [59, Definition 2.1]. Thus the following theorem also 
answers a question raised in [59, Remark 2.6(b)]: There the authors observe 
that taking a projection generating function as wavelet gives rise to orthogo- 
nality relations among the wavelet coefficients which closely resemble those for 
irreducible square-integrable representations, even though the representation 
at hand is not irreducible. The explanation for this phenomenon is that the 
orthogonality relations in the discrete series case are particular instances of 
the orthogonality relations arising in connection with the Planclrerel formula. 

A comparison of the following theorem with Theorem 4.20 gives a first 
hint towards the connection between abstract and concrete admissibility con- 
ditions. 

Theorem 5.8. Let (nu, Hu) be a subrepresentation of it corresponding to 
some invariant measurable subset U. Then 

g € Tiu is bounded <t=> / \g(h~ l .oj )\ 2 dp,H(h) < constant (5-3) 

J H 

g £ Hu is cyclic 4=> / ^{hT 1 .u>)\ 2 dfin{h) yf 0 (5-4) 

J H 

g £ Ttu is admissible <t=> / ^(hT 1 .u>)\ 2 dpH{h) = 1 (5-5) 

J H 

Here all right-hand sides are understood to hold almost everywhere. In partic- 
ular, if 7 tu has a bounded cyclic vector, then U C fl c (up to a null set). 

Proof. We start by explicitly calculating the L 2 -norm of V g f, for f,g £ Hu- 
The following computations are generalizations of the argument used for the 
ID continuous wavelet transform in Example 2.28, see also [22, 48, 113]. 
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\\ v af\\l^(G) = / \(f^( x ,h)g )\ 2 dp G (x,h) 



if, (ir{x,h)g) A ) dp, G (x,h) 



/ R k 



f(uj)\ det(h)\ 1 ^ 2 e 2 nl ' yx g(h 1 .co)duj 



dp G (x,h) 



IH 



R fc 



f(ut)e 2 ,riux g{h- 1 M)<Lt 



d\{x)dg,H(h) 



[ f \F( 4 >h)(-x )\ 2 d\(x)dfi H (h). 
J H JR k 



Here <j>h{w) = / {x>)g{h~ l .to ) , and T denotes the Fourier transform on L 1 ( 

An application of Plancherel’s formula - or more precisely, the extension of 
2.22 to - to the last expression yields 



(w)| cLod)-iH(h) = 

IhJ R fc JhJ R fc 



LM'if 

JR k \Jh 



/M | | g(h 1 .u)\~ dudg H (h) 
2 

( I 

H 



g(/i .a;) d/^nih) ) dcu . 



Now (5.3) through (5.5) are obvious. Moreover, it is easily seen that whenever 
the stabilizer H ' u is noncompact, we have 

f \d(h~ 1 .u))\ 2 dg H (h) G {0,oo}, 

J H 

(cf. also the proof of [48, Theorem 10]), hence V g f G L 2 (G) entails that the 
pointwise product fg vanishes a.e. outside of f2 c . In particular, a bounded 
cyclic vector vanishes almost everywhere outside of T2 C , hence we obtain in 
such a case that U C fl c (up to a null set). 

For the construction of admissible vectors we first decompose Lebesgue 
measure A on Q rc into measures on the orbits and a measure on fl rc jH . Then 
we address the relationship of the measures on the orbits to the Haar measure 
of H. 

Lemma 5.9. (a) There exists a measure X on fi rc / H and on each orbit 0{ 7 ) 
a measure /3q( 7 ) such that for every measurable A C fi rc the mapping 



Oil) 



lot 7 ) 



1 A(w)d/?o( 7 )( w ) 



is X-measurable, and in addition 



A(H) = / / l A (u)df3 OM (u,)dX(0(i)). 

JR k /H 
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(b) Let (A, (/3o(7))o(7)6r2rc/ff) &e as in ( a )- For 7 G ^rc de/zne /z 0(7 ) as the 
image measure of fin under the projection map p 7 : h i— > h 1 ^ 0 ( 7 ) * s a 
a -finite measure, and its definition is independent of the choice of represen- 
tative 7. Then, for almost all 7 £ f2 rc , the po(-y) and Po{ 7) are equivalent, 
with globally Lebesgue-measurable Radon-Nikodym-derivatives: There ex- 
ists an (essentially unique) Lebesgue-measurable function k : I2 rc — > R + 
such that for cv £ 0{ 7 ), 



d Po{ 7) x 
d/r 0 ( 7 ) 



k(u) 



(c) The function n fulfills the semi-invariance relation 

^(hr 1 ,u>) = k(<x>)Z1g(/i ) _1 . (5-6) 



In particular, k is H -invariant iff G is unimodular. In that case, we can 
in fact assume that k = 1 almost everywhere. This choice determines the 
measure A uniquely. 

Proof. Statement (a) is a special instance of Proposition 3.28. 

In order to prove part ( 6 ), well-definedness and cr-finiteness of fJ-O(-y) follow 
from compactness of H 7 . The independence of the representative 7 of the orbit 
follows from the fact that pn is leftinvariant. To compute the Radon-Nikodym 
derivative k, we first introduce an auxiliary function £ : I2 rc — > : Fix a 

Borel-measurable transversal A C J2 rc of the U-orbits. Then the mapping 
r : Ax H — > I2 rc , t(uj,H) = h ^ 1 .10 is bijective and continuous, hence, since 
A x H is a standard Borel space, r ^ 1 : fl rc — > A x H is Borel as well, 
by [15, Theorem 3.3.2]. If we let T _ 1 ( 7 )ij denote the U-valued coordinate 
of t~ 1 { 7 ), then £( 7 ) := Ag{t~ 1 ( 7 )//) is a Borel-measurable mapping. Since 
Aq is constant on every compact subgroup (in particular on all the little fixed 
groups of elements in f2 rc ), a straightforward calculation shows that t satisfies 
the semi- invariance relation £(h~ l ,u>) = £(c v)Ac(h)- 1 . 

Next fix an orbit 0( 7 ) and let us compare the measures /3o(j) and ipoM- 
Since 



dp 0 (j)(h 1 .u>) = A H (h)dpo('i)(u) and d/3 0 (j)(h 1 .u) = | det (h)\d (3 O ( 7 )(oj) , 

the definition of £ ensures that ipopi) aR d Po( 7 ) behave identically under 
the action of H . Moreover, they are cr-finite and quasi-invariant, hence equiv- 
alent. Since they have the same behaviour under the operation of H, the 
Radon-Nikodym derivative turns out to be a positive constant on the orbit. 
Summarizing, we find for w £ 0{ 7 ) that 

M = co( 7 ) > 

with £, cq( 7 ) > 0 , and it remains to show that cg( 7 ) depends measurably on 
the orbit. 



d(3p( 7 ) 

dpO(-y) 
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For this purpose pick a relatively compact open neighborhood B C H of 
the identity. Then AB = t(A x B) C fl rc is Borel-measurable, as a continuous 
image of a standard space, hence lyis, the indicator function of AB , is a Borel- 
measurable function. Both 

</>i : 0 ( 7 ) / 1 AB(u)d(3o(y)(u) 

JO( 7 ) 

and 

</>2 : 0(7) i-> / l j4B (w)^(w)d/i C i( 7 )(w) 

• 10 ( 7 ) 

are measurable functions: The first one is by choice of the /3e>( 7 ), see part (a). 
The second one is measurable by Fubini’s theorem, applied to the mapping 
(u,h) 1 — > 1 ab(/i _ 1 .w)^(/i _ 1 .w) on x 77 (recall the definition of HoG))- 
In addition, both functions are finite and positive on 72 rc . We have 

*£2(0(7)) = [ lAB(w)t(u)dno(j)(u) = [ A G (h)dp H (h) , 

Jo( 7 ) Jpy 1 (AB) 

and p 7 (AB) is relatively compact and open, hence it has finite and positive 
Haar measure. Since in addition Aq is positive and bounded on p~ 1 (AB), we 
find 0 < <(>2(0(7)) < 00. Hence 



^i( 0 ( 7 )) = c 0 ( 7 )</> 2(0(7)) 



can be solved for which thus turns out to depend measurably upon 

0(7). Hence 



k(u>) 



df3o( 7 ) 
dno(j) 



7(w)c 0(7 ) 



is a Lebesgue-measurable function. 

The remaining part (c) is simple to prove: The semi-invariance relation of £ 
entails the relation for k. The normalization is easily obtained: If k is constant 
on the orbits, it defines a measurable mapping k on fl rc /H. If we replace each 
/3 c>( 7 ) by /io( 7 ), we can make up for it by taking k( 0(7))<7A(0(7)) as the new 
measure on the orbit space. The new choice has the desired properties. The 
uniqueness of A follows from the usual Radon-Nikodym arguments. 



Remark 5. 1 0. Let us for the next two sections fix a choice of A. Note that this 
also uniquely determines the function k. In the unimodular case we take k to 
be 1, which in turn determines A uniquely. 

As we shall see in Theorem 5.23, the choice of a pair (A, k) corresponds 
exactly to a choice of Plancherel measure and the associated family of Duflo- 
Moore operators, at least on a subset of G. 



Before we turn to the construction of admissible vectors, we introduce some 
notation to help clarify the construction: To a function g on U we associate 
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two auxiliary 77- invariant functions Tnfg) and Snl/g) such that admissibility 
of g translates to a condition on Th (g) and square-integrability to a condition 
on S H (g)- 

Definition 5.11. For a measurable function g on I2 rc , let Tjj(g) denote the 
function 

Th{§){u) ~ \ I \g{l)\ 2 dgo{u,){l) 

\Jo(w) 

[ \ K (i)~ 1 / 2 d('y )\ 2 dPo(w){i) 

J 0(w) 

Tnifg) is a measurable , H -invariant mapping f2 rc — » Kj U {oo}. The admis- 
sibility condition can then be reformulated: 

g G L 2 {U) is admissible <t=> Tn(g) = 1 ( a.e. on U) . (5-7) 

Similarly, weak admissibility is equivalent to the requirement that Tnfg) G 
L°°([/) and Tn(g) > 0 almost everywhere. We can also define 

■= \ [ \dh)\ 2 d(3o(u)(T) 

\Jo(w) 

By our choice of measures, Sh and Th coincide iff G is unimodular. Both 
Tnfg) an d Sn(g) may (and will) be regarded as functions on the quotient 
space U/H. By the choice of the /3 q( u \, 





\g(u)\ 2 du> 




\S H (g)(0(u;))\ 2 dX(0(u;)) , 



(5.8) 



so thatg is square-integrable iff Sn(d) a square-integrable function on U/H. 

Now we can address the existence of admissible vectors. The following 
theorem is essentially the same as [77, Theorem 1.8]. Again, a comparison of 
this theorem with the abstract version in Theorem 4.22 is instructive. The 
connection will be made explicit in Theorem 5.23 below. 



Theorem 5.12. Let U C fi rc be measurable and H -invariant. Then ttu has 
a bounded cyclic vector. It has an admissible vector iff either 

(i) G is unimodular and \{U/H) < oo. 

(ii) G is nonunimodular. 

Note that the strategy for the construction of admissible vectors in the 
following proof is similar to the arguments in [77], but also to the construc- 
tion in Theorem 4.23. It amounts to treating the admissibility condition - 
involving Th - first, and then adjusting the construction to fulfill the square- 
integrability condition - involving Sh - as well. 
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Proof. Recall that by the last remark we have for each admissible vector g that 
Tff(g) is constant almost everywhere. At the same time, in the unimodular 
case it is square-integrable as a function on U/H , because of Sh = Th- This 
shows the necessity of (i) in the unimodular case. 

To prove the existence of admissible vectors, we first construct a func- 
tion g on U fulfilling the admissibility condition (5.7), and then modify the 
construction to provide for square-integrability. 

For this purpose we recycle the sets A C H rc and B C H from the proof of 
Lemma 5.9. We already observed there that / = 1,4 b is Lebesgue-measurable, 
and that Tjj(f) is positive and finite almost everywhere on U. Hence we 
may define g = f/Tn(f), which fulfills the admissibility criterion. In the 
unimodular case, equation (5.8) together with Sh = Th shows that g £ L 2 (U). 

In the nonunimodular case, we modify g as follows: For every 7 £ U, the 
compactness olp~ 1 {AB) entails that Aq is bounded on that set. Thus Sn(g) 
is positive and finite almost everywhere. Since A is cr-finite, we can write 
U/H = U„ 6N V n , with disjoint V n of finite measure, such that in addition 
S H (g) is bounded on each V n (here we regard Snig) as a function on the 
quotient). In particular, Sn(g) • lv„ is square-integrable on U/H. Now let 
U n C U be the inverse image of V„ under the quotient map, and for ho £ H 
and n, k n £ N, denote by 

9^{u) ~ A H (h 0 ) k " /2 f2(h- 1 .u $") • lt/» . 

Then the normalization ensures that g n has the following properties: 

T H {g/f) = l Un (5-9) 



and 



SH{g n ) = A H (ho) k " /2 \ det(/i 0 )| kn/2 S H (g) • 1 u n 

= A G (h 0 ) kn/2 S H (g)-l Un . (5.10) 

Hence the following construction gives an admissible vector: Choose ho £ H 
such that A G (ho) <1/2, pick k n £ N satisfying 

2- kn \\S H (g)Au n \\l<2- n (5.11) 

and let g(w) := AH(ho) kn ^ 2 f 2 {h~ 1 .Wq’ 1 ), for u> £ U n . Then (5.9) implies that 
Tn(g) = 1 a.e., whereas (5.10) and (5.11) ensure that Sn(g) £ L 2 (U/H,X). 

A bounded cyclic vector for ttjj -which is missing in the unimodular case- 
can be obtained by similar (somewhat simpler) methods. 

Remark 5.13. In Theorem 5.12 we cannot replace f2 rc by the bigger set fl c . 
To give a nonunimodular example, let H = {2 k h : k £ Z, h £ SL(2, Z)}, which 
is a discrete subgroup of GL(2,R). Whenever (71,72) € R 2 is such that 71/72 
is irrational, the stabilizer of (71,72) in H is finite. Hence the set Q c is a 




